Databricks Pipeline Engineer
ECS is seeking a Databricks Pipeline Engineer to work remotely. Please Note: This position is contingent upon additional funding.
ECS is seeking a Databricks Pipeline Engineer to support the design, implementation, and long-term operation of Databricks within a complex Government enterprise environment. This role will work closely with various stakeholders during initial implementation and will support with data engineering projects as Databricks is rolled out within the environment.
The ideal candidate will bring strong Databricks and AWS experience, familiarity with architecting solutions for scale and governance, and is comfortable integrating Databricks with other data platforms.
Key responsibilities include:
• Lead data engineering efforts within Databricks to include pipeline development within Databricks on AWS in an enterprise environment
• Provide unification for organization and enterprise data capabilities to break down organizational data and operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouse
• Support the integration of Databricks with existing analytics platforms and metadata solutions
• Serve as a technical advisor to stakeholders and help upskill internal teams through guidance/documentation
• Assist and develop customer use case applications of Databricks
Salary Range: $150,000 - $180,000
General Description of Benefits
Requirements:
• Must be a US Citizen
• Ability to successfully maintain a DHS Entry on Duty (EOD)/Public Trust
• Minimum 7 years of hands-on experience architecting, designing, data engineering with Databricks and AWS in a government setting.
• Strong understanding and experience in areas such as Apache Spark, Lakebase, Lakehouse architectures, Delta Lake, Delta Sharing, Medallion Architecture, Data & AI Governance, and use case acceleration.
• Demonstrated hands-on experience with AWS Cloud Native data and ETL capabilities (S3, Lambdas, Glue, etc.)
• Demonstrated experience leveraging data to provide search, enrichment, correlation, AI/ML Model Training, in alignment with government mission and business use cases
• Experience integrating Databricks with other analytics platforms.
• Prior consulting or customer-facing experience in data architecture or modernization initiatives.
• Strong Python skills.
• Experience in Agile environments and managing cross-functional technical delivery.
Req Benefits:
https://ecstech.com/careers/benefits/">https://ecstech.com/careers/benefits/
ECS is seeking a Databricks Pipeline Engineer to support the design, implementation, and long-term operation of Databricks within a complex Government enterprise environment. This role will work closely with various stakeholders during initial implementation and will support with data engineering projects as Databricks is rolled out within the environment.
The ideal candidate will bring strong Databricks and AWS experience, familiarity with architecting solutions for scale and governance, and is comfortable integrating Databricks with other data platforms.
Key responsibilities include:
• Lead data engineering efforts within Databricks to include pipeline development within Databricks on AWS in an enterprise environment
• Provide unification for organization and enterprise data capabilities to break down organizational data and operational silos, including mechanisms to standardize and migrate existing data to a unified data plane/warehouse
• Support the integration of Databricks with existing analytics platforms and metadata solutions
• Serve as a technical advisor to stakeholders and help upskill internal teams through guidance/documentation
• Assist and develop customer use case applications of Databricks
Salary Range: $150,000 - $180,000
General Description of Benefits
Requirements:
• Must be a US Citizen
• Ability to successfully maintain a DHS Entry on Duty (EOD)/Public Trust
• Minimum 7 years of hands-on experience architecting, designing, data engineering with Databricks and AWS in a government setting.
• Strong understanding and experience in areas such as Apache Spark, Lakebase, Lakehouse architectures, Delta Lake, Delta Sharing, Medallion Architecture, Data & AI Governance, and use case acceleration.
• Demonstrated hands-on experience with AWS Cloud Native data and ETL capabilities (S3, Lambdas, Glue, etc.)
• Demonstrated experience leveraging data to provide search, enrichment, correlation, AI/ML Model Training, in alignment with government mission and business use cases
• Experience integrating Databricks with other analytics platforms.
• Prior consulting or customer-facing experience in data architecture or modernization initiatives.
• Strong Python skills.
• Experience in Agile environments and managing cross-functional technical delivery.
Req Benefits:
https://ecstech.com/careers/benefits/">https://ecstech.com/careers/benefits/