Remote Multiyear Azure Data Lakehouse Engineer or Architect Full time or Part time

Remote Full-time
We are seeking an experienced Senior Data Lakehouse Architect & Consultant to lead the design and execution of a scalable, robust, and secure production environment for our data lakehouse infrastructure. This individual will be instrumental in migrating existing data feeds, processes, and products from development to production while ensuring minimal disruption. The ideal candidate will possess deep expertise in modern data architectures, Microsoft Azure cloud platform and data lakehouse tool suite, DevOps practices, and data governance, and be able to develop effective strategies that bridge both IT and power-user communities. Key Responsibilities: • Production Environment Design & Migration: • Lead the design and architecture of the data lakehouse production environment based on the client's existing development environment. • Develop a comprehensive migration plan for transitioning existing data feeds, processes, and products from the development environment to the new production environment. • Collaborate with cross-functional teams to ensure a smooth and efficient migration process, minimizing disruptions to operations. • Perform gap analysis to understand any challenges within current data flow, architecture, and product design in the development environment and make recommendations for addressing low-hanging fruit during the migration. • Data Governance & DevOps Implementation: • Develop data governance frameworks that promote data security, accessibility, and integrity across the organization. • Create and implement robust Azure DevOps processes for both IT teams and power-user communities to facilitate efficient ongoing development. • Ensure CI/CD (Continuous Integration/Continuous Deployment) pipelines are in place for new data products and processes. • Establish monitoring, alerting, and reporting systems to manage performance, security, and data quality across the lakehouse ecosystem. • Stakeholder Collaboration & Leadership: • Work closely with business stakeholders, IT teams, and power users to deeply understand their data needs and ensure alignment with the overall architecture and governance strategies. • Lead workshops and discussions with key stakeholders to ensure a clear understanding of the migration strategy, timelines, and any potential challenges. • Act as a thought leader within the organization by sharing insights, trends, and innovations in the data lakehouse space. • Serve as the subject matter expert for all aspects of the data lakehouse architecture providing guidance and best practices and for ongoing development and optimization. • Foster a culture of knowledge sharing across the organization by documenting key processes, decisions, and architectural frameworks. • Conduct training sessions and workshops for IT teams and power-user communities, ensuring knowledge transfer of new technologies, processes, and best practices. • Create and maintain internal knowledge repositories to ensure ongoing accessibility to best practices, lessons learned, and key design decisions. • Strategic Planning & Roadmap Development: • Develop a long-term strategic roadmap for scaling the lakehouse architecture, incorporating future requirements from both IT and business teams. • Stay informed about the latest developments in data lakehouse technologies, cloud platforms, and best practices, incorporating them into the organization's data strategy. Qualifications: • Experience: • Minimum of 10 years in data architecture and engineering roles, with at least 3-5 years specifically focused on data lakehouse or data lake technologies. • Proven experience designing and migrating large-scale data infrastructures from development to production environments. • Extensive experience working with cloud platforms - especially Microsoft Azure and respective data management tool suite. • Technical Skills: • Expert-level knowledge in data lakehouse architectures (e.g., Delta Lake, Snowflake, Databricks, etc.) in a MSFT Azure environment. • Strong experience with data integration, ETL/ELT processes, and data warehousing. • Proficiency with Azure SQL, Python, Azure Synapse, MSFT Fabric (Synapse, PowerBI, Data Factory), MSFT Purview. • Knowledge of Alteryx data analytics platform is helpful. • Knowledge of SCADA PI data feeds is helpful. Apply tot his job
Apply Now

Similar Opportunities

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote Full-time

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote Full-time

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote Full-time

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote Full-time

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote Full-time

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote Full-time

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote Full-time

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote Full-time

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote Full-time

USPS Office Helper

Remote Full-time

Data Quality and Governance Manager (Remote US) in Schaumburg, IL in Experian (job Id: 1673426771)

Remote Full-time

**Experienced Remote Customer Service Representative – Deliver Exceptional Customer Experiences from the Comfort of Your Home**

Remote Full-time

Experienced Customer Service Specialist for Remote Live Chat Support – Immediate Start Opportunity with blithequark for Entry-Level Candidates

Remote Full-time

**Experienced Remote Customer Service Representative – Delivering Exceptional Arenaflex Experiences**

Remote Full-time

Amazon Product Tester in united states

Remote Full-time

[Remote] Director of Partnerships (Pay-Per-Call / Home Services)

Remote Full-time

▷ 3 Days Left! Private Member Group Senior - (Remote)

Remote Full-time

Experienced Remote Data Entry and Customer Support Specialist for Immediate Start at arenaflex

Remote Full-time

**Experienced Entry-Level Chat Support Specialist – Remote Customer Service Representative**

Remote Full-time

Outside Sales Consultant

Remote Full-time
← Back to Home