Lead Data Engineer- Azure & Databricks
MatchPoint Solutions is a fast-growing, young, energetic global IT-Engineering services company with clients across the US. We provide technology solutions to various clients like Uber, Robinhood, Netflix, Airbnb, Google, Sephora, and more! More recently, we have expanded to working internationally in Canada, China, Ireland, UK, Brazil, and India. Through our culture of innovation, we inspire, build, and deliver business results, from idea to outcome. We keep our clients on the cutting edge of the latest technologies and provide solutions by using industry-specific best practices and expertise.We are excited to be continuously expanding our team. If you are interested in this position, please send over your updated resume. We look forward to hearing from you!Lead Data Engineer - Azure & Databricks6 months probable extension, with possible extensions.Remote$75 - $80/hr on W2 * Extensive Data Modeling background with lake house architecture, someone who can lead and drive conversations with business while also being able to do hands-down data modeling.
Data engineering experience on Big Data Platforms, especially with Databricks on the Azure environment.
Salesforce is the core data source.
Primary Duties and AccountabilitiesDesign and implement scalable data models, including conceptual, logical, and physical models, to meet business objectives and support data-driven decision-making across the organization.Lead the development and optimization of data pipelines and data warehousing solutions, ensuring data accuracy, consistency, and accessibility for reporting and business intelligence.Collaborate with business and IT teams to translate business needs into comprehensive data solutions, aligning them with strategic goals while maintaining high data quality, integrity, and security.Establish and enforce data governance practices to ensure compliance with regulatory standards and industry best practices, while fostering a culture of data stewardship and responsibility.Continuously review and optimize existing data systems, identifying opportunities for improvement in efficiency, performance, and user satisfaction, while mitigating potential risks and ensuring project success.Ensure all data solutions adhere to enterprise architecture frameworks, promoting consistency, scalability, and ongoing development while supporting the growth and development of data teams.Minimum QualificationsBachelor's degree in Computer Science, Information Systems, Data Science, or a related field.10+ years of experience in IT, with at least 5 years in data architecture, data engineering, or similar role. Proven expertise in designing and delivering large-scale data solutions.Hands-on experience with Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and other Azure data components.Extensive expertise in data architecture, including data modeling, ETL pipelines, data lakes, and business intelligence solutions, with proficiency in Big Data technologies (e.g., Hadoop, Spark, Kafka) and both relational and NoSQL databases (e.g., SQL Server, Cosmos DB), along with a strong understanding of Data Lake, Data Mart, Data Mesh, and Data Vault concepts.Proficiency in data modeling for both OLTP and OLAP systems, and familiarity with data formats such as Delta Lakes, Parquet and AvroSolid understanding of data governance, data security best practices, and cybersecurity fundamentals in the context of cloud-based and enterprise data systems.Experience in data profiling and data cataloging to ensure high-quality, well-structured data. Ability to maintain up-to-date Data Dictionaries in a disciplined manner.Hands-on experience with data modeling tools such as Erwin, Power Designer, or similar platforms for creating and managing complex data models.Experience in analyzing functional and non-functional business requirements and translating them into technical data requirements.Excellent communication skills to convey complex technical concepts to both technical and business stakeholders. Strong consulting and negotiation skills with internal teams and external vendors.MatchPoint Solutions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Apply for the job now!
Apply Now
Data engineering experience on Big Data Platforms, especially with Databricks on the Azure environment.
Salesforce is the core data source.
Primary Duties and AccountabilitiesDesign and implement scalable data models, including conceptual, logical, and physical models, to meet business objectives and support data-driven decision-making across the organization.Lead the development and optimization of data pipelines and data warehousing solutions, ensuring data accuracy, consistency, and accessibility for reporting and business intelligence.Collaborate with business and IT teams to translate business needs into comprehensive data solutions, aligning them with strategic goals while maintaining high data quality, integrity, and security.Establish and enforce data governance practices to ensure compliance with regulatory standards and industry best practices, while fostering a culture of data stewardship and responsibility.Continuously review and optimize existing data systems, identifying opportunities for improvement in efficiency, performance, and user satisfaction, while mitigating potential risks and ensuring project success.Ensure all data solutions adhere to enterprise architecture frameworks, promoting consistency, scalability, and ongoing development while supporting the growth and development of data teams.Minimum QualificationsBachelor's degree in Computer Science, Information Systems, Data Science, or a related field.10+ years of experience in IT, with at least 5 years in data architecture, data engineering, or similar role. Proven expertise in designing and delivering large-scale data solutions.Hands-on experience with Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and other Azure data components.Extensive expertise in data architecture, including data modeling, ETL pipelines, data lakes, and business intelligence solutions, with proficiency in Big Data technologies (e.g., Hadoop, Spark, Kafka) and both relational and NoSQL databases (e.g., SQL Server, Cosmos DB), along with a strong understanding of Data Lake, Data Mart, Data Mesh, and Data Vault concepts.Proficiency in data modeling for both OLTP and OLAP systems, and familiarity with data formats such as Delta Lakes, Parquet and AvroSolid understanding of data governance, data security best practices, and cybersecurity fundamentals in the context of cloud-based and enterprise data systems.Experience in data profiling and data cataloging to ensure high-quality, well-structured data. Ability to maintain up-to-date Data Dictionaries in a disciplined manner.Hands-on experience with data modeling tools such as Erwin, Power Designer, or similar platforms for creating and managing complex data models.Experience in analyzing functional and non-functional business requirements and translating them into technical data requirements.Excellent communication skills to convey complex technical concepts to both technical and business stakeholders. Strong consulting and negotiation skills with internal teams and external vendors.MatchPoint Solutions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
Apply for the job now!
Apply Now