100% Remote // GCP Data Architect (Big Query, Python, ETL DHW)
Full time
Job Description:
Primary Skill -
• GCP Data engineering services – Big Query, Airflow, Data Proc, Data Flow
• Data warehousing knowledge and good SQL skills. Working experience on data migration from On-premise to Cloud
Roles and Responsibilities:
• Collaborate with cross-functional teams to design and implement scalable and reliable systems on Google Cloud Platform considering optimal performance, security, and cost-effectiveness.
• Build data ingestion pipelines to extract data from various sources (Azure Blob, Azure SQL, Flat files, Semi-structured sources, AWS S3) into the data warehouse in GCP.
• Utilize GCP services to build robust and scalable data solutions.
• Design, develop, and maintain data pipelines and implement data architecture on GCP using services such as Big Query, Cloud Storage, and Cloud Composer.
• Expertise in tools and technology that help in the process of data collection, cleaning, transforming, and modeling data to achieve useful information.
• Leverage GCP capabilities and technologies for migrating existing databases to cloud.
• Implement and optimize Big Query tables and complex SQL queries for efficient data retrieval, performance, and efficiency.
• Experience in Data Migration from On-premises Database to Big Query and experience in BQ conversion.
• Experience and knowledge in building data pipelines and scheduling using Cloud Composer (Airflow) and data and file transformation using Python.
EDW (Enterprise Data Warehouse) and Data Model Designing:
• Experience with Data modeling, Data warehousing, and ETL processes.
• Work closely with Business and analysts to design and implement data models for effective data representation and analysis.
• Ensure data models meet industry standards and compliance requirements in the health-care domain.
• Contribute to the design and development of the enterprise data warehouse architecture.
• Implement best practices for data storage, retrieval, and security within the EDW.
• Apply domain-specific knowledge to ensure that data solutions comply with health-care industry regulations and standards.
• Stay updated on industry trends and advancements in health-care data management.
• Work collaboratively with cross-functional teams, including Business Teams, analysts, and software engineers, to deliver integrated and effective data solutions.
• Participate in code reviews and provide constructive feedback to team members.
Qualifications (Required Technical skills/Experience):
• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proficiency in GCP and in-depth knowledge of GCP services, Big Query, Cloud Functions, and Composer.
• Strong programming skills in Data Engineering Python.
• Experience with data modeling, SQL, and EDW design.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Proficiency in version control systems, particularly Git.
• Strong understanding of Data warehouse concepts and data lakes.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Apply Now
Job Description:
Primary Skill -
• GCP Data engineering services – Big Query, Airflow, Data Proc, Data Flow
• Data warehousing knowledge and good SQL skills. Working experience on data migration from On-premise to Cloud
Roles and Responsibilities:
• Collaborate with cross-functional teams to design and implement scalable and reliable systems on Google Cloud Platform considering optimal performance, security, and cost-effectiveness.
• Build data ingestion pipelines to extract data from various sources (Azure Blob, Azure SQL, Flat files, Semi-structured sources, AWS S3) into the data warehouse in GCP.
• Utilize GCP services to build robust and scalable data solutions.
• Design, develop, and maintain data pipelines and implement data architecture on GCP using services such as Big Query, Cloud Storage, and Cloud Composer.
• Expertise in tools and technology that help in the process of data collection, cleaning, transforming, and modeling data to achieve useful information.
• Leverage GCP capabilities and technologies for migrating existing databases to cloud.
• Implement and optimize Big Query tables and complex SQL queries for efficient data retrieval, performance, and efficiency.
• Experience in Data Migration from On-premises Database to Big Query and experience in BQ conversion.
• Experience and knowledge in building data pipelines and scheduling using Cloud Composer (Airflow) and data and file transformation using Python.
EDW (Enterprise Data Warehouse) and Data Model Designing:
• Experience with Data modeling, Data warehousing, and ETL processes.
• Work closely with Business and analysts to design and implement data models for effective data representation and analysis.
• Ensure data models meet industry standards and compliance requirements in the health-care domain.
• Contribute to the design and development of the enterprise data warehouse architecture.
• Implement best practices for data storage, retrieval, and security within the EDW.
• Apply domain-specific knowledge to ensure that data solutions comply with health-care industry regulations and standards.
• Stay updated on industry trends and advancements in health-care data management.
• Work collaboratively with cross-functional teams, including Business Teams, analysts, and software engineers, to deliver integrated and effective data solutions.
• Participate in code reviews and provide constructive feedback to team members.
Qualifications (Required Technical skills/Experience):
• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proficiency in GCP and in-depth knowledge of GCP services, Big Query, Cloud Functions, and Composer.
• Strong programming skills in Data Engineering Python.
• Experience with data modeling, SQL, and EDW design.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Proficiency in version control systems, particularly Git.
• Strong understanding of Data warehouse concepts and data lakes.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Apply Now