TD Bank: Azure Data Engineer(Remote)
Opp ID Req. ID RGS ID Skill Role Job Description 1251173 8137809, 8137808, 8137807 3628628 Azure Data Factory, Azure Databricks, ADLS, Datadog, Azure SQL DB, Azure Synapse Azure Data Engineer(Remote) Job Description for Azure Data Engineer: • Design and develop ETL processes based on functional and non-functional requirements in Azure platform • Design and develop migration process from SQL Server to Azure platform • Understand the full end to end development activities from design to go live for ETL development in Azure platform • Recommend and execute improvements • Document component design for developers and for broader communication. • Understand and adopt an Agile (SCRUM like) software development mindset • Follow established processes/standards, business technology architecture for development, release management and deployment process • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews. • Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer • Proficient in creating Data Factory pipelines for on-cloud ETL processing; copy activity, custom Azure development etc. Must-have skills • Undergraduate Degree or Technical Certificate. • Microsoft Azure certified - Data Engineer • Working experience (> 3 years) in Azure Data Factory, Azure Databricks, ADLS, Datadog, Azure SQL DB, Azure Synapse • Hands-on experience in Python / Spark / Pyspark / JSON • SQL Server (SSIS) • Working experience with data modeling, relational modeling and dimensional modeling • General knowledge about file formats (e.g. XML, CSV, JSON), databases (e.g. MS SQL, Oracle) and different type of connectivity is also very useful. • Data files movement via mailbox • Source-code versioning/promotion tools, e.g. Git/Jenkins • Orchestration tools in Azure platform Nice-to-have skills • Shell Script • Java / Scala • Experience in Agile environment • Tracking and collaboration tools (e.g. JIRA, Confluence, MS Teams) Apply tot his job