Staff Engineer - Big Data Engineer
The ideal candidate will have extensive experience in data engineering, AWS cloud services, platform engineering, and database management”including Azure Storage Services. This role will focus on integrating banking applications with a metering platform element. Metering platform element provides a standardized way for an application or service to emit business and analytical events across all MA applications and services. The candidate will be responsible for understanding the technical implementation of the metering platform, engaging with banking application owners to understand their use cases, and providing technical guidance and solutions for integration with the platform element. Experience with data engineering, data analytics and reporting are essential. Key Responsibilities: Integrate banking applications with a metering platform, ensuring seamless data flow and accurate tracking of essential business metrics. Engage with banking application owners to understand their requirements and provide integration solutions with metering platform. Manage and optimize integration of Azure Blob Storage with Banking applications. Support data analytics and reporting initiatives. Implement best practices for data governance, quality, and security while integrating banking applications with the metering platform element. Assist in automating platform operations and deployments using Infrastructure as Code (IaC) tools (e.g., Terraform, CloudFormation). Monitor, troubleshoot, and resolve issues across data workflows and platform infrastructure. Collaborate with the metering team to assist in feature development Document technical solutions and mentor team members as needed. Required Skills & Experience: 5+ years of experience in data engineering and platform engineering roles. Expertise in AWS Data services (e.g., S3, Lambda, Glue, Redshift) along with core AWS services such as IAM, EC2, RDS. Experience with Azure data services, especially Azure Blob Storage. Strong proficiency in SQL, Python, and ETL orchestration tools. Experience with Java and C#. Experience with database design, optimization, and management (both SQL and NoSQL). Solid understanding of data analytics, reporting, and BI concepts. Experience integrating applications with metering or billing platforms is highly desirable. Familiarity with DevOps practices and CI/CD pipelines. Excellent problem-solving, communication, and stakeholder engagement skills. Preferred Qualifications: Experience in the banking or financial services sector. Experience with data security, compliance, and governance frameworks. Prior experience working in a contractor or consulting capacity. Must have Skills: Metering Good To Have Skills: ETL Load Orchestration (Strong), C# (Strong) We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (19000+ experts across 33 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in! Originally posted on Himalayas