Databricks Engineer (6 month contract-to-hire, NO C2C, ONLY USC or GC)

Databricks Engineer • Remote • 6-month contract-to-hire. • $90.00/hr. • U.S. Citizens and Permanent Residents (Green Card) preferred. • NO C2C or H-1B sponsorship. Mandatory EAD card valid through 10/2026, no exceptions. Seeking a highly skilled Databricks Engineer with advanced expertise in Databricks CI/CD pipelines and streaming table development. The ideal candidate will have hands-on experience implementing robust CI/CD processes within the Databricks environment, enabling efficient code deployment, automated testing, and streamlined release management. Key responsibilities include designing and optimizing streaming tables to support real-time analytics, ensuring seamless schema evolution to accommodate changing business requirements. Candidates should demonstrate proficiency in schema optimization techniques to maximize performance and reliability, as well as a deep understanding of data engineering best practices on the Databricks platform. RESPONSIBILITIES • Develop, maintain, and optimize Databricks CI/CD pipelines for automated deployment and testing • Evaluate, understand and assist in planning for compute and job cluster resources in Azure Databricks environments • Design and implement streaming tables with support for schema evolution and optimization • Collaborate with data architects and business stakeholders to understand data requirements and deliver scalable solutions • Troubleshoot and resolve issues related to table schemas, data ingestion, and streaming performance • Ensure data quality, security, and compliance throughout the engineering process • Databricks environmental change tracking EDUCATION & EXPERIENCE QUALIFICATIONS • Bachelor’s degree in Computer Science, Engineering, or equivalent experience in related field • 5+ years of experience in data engineering, with a focus on cloud data solutions KNOWLEDGE, SKILLS, OR ABILITIES • Proficiency in Azure cloud computing and data architecture design • Implementation of a data lake solution using Azure Databricks, integrating various data sources, and enabling analytics for business intelligence • Proven experience with Databricks, including CI/CD pipeline management and streaming table development • Expertise in schema evolution and optimization within streaming data architectures • Strong programming skills in Python and SQL • Familiarity with YAML a plus • Proficient with GIT • Excellent problem-solving and communication abilities #SRG Pay: $90.00 per hour Application Question(s): • YES or NO: Are you a U.S. Citizen or Permanent Resident (Green Card)? • YES or NO: Are you seeking C2C or employment sponsorship? • YES or NO: Are you on a student visa? If so, please share classification and EAD expiration: Experience: • Databricks engineering: 3 years (Required) • data engineering: 3 years (Required) Work Location: Remote