[Remote] Data Engineer - CTJ - Secret

Note: The job is a remote job and is open to candidates in USA. Microsoft is one of the largest enterprise service companies in the world, and they are seeking a talented Data Engineer to join their Insider Risk Engineering team. In this role, you will develop and manage data pipelines and advanced insider risk detections to proactively identify and address potential threats. Responsibilities Design, build, and optimize data pipelines to ingest, process, and prepare data for use in insider risk detection models. Join, filter, and integrate diverse data sources to create comprehensive datasets that enable effective and accurate insider risk detections Work with large datasets, applying advanced data transformation techniques to ensure data quality and accessibility for risk detection. Develop, test, and deploy insider risk detection models based on data-driven insights to proactively identify anomalous or risky behavior patterns Collaborate with insider risk team members to define and refine detection use cases, ensuring they are accurate, scalable, and aligned with business needs. Share knowledge and actively contribute ideas in team technical discussions Maintain and monitor insider risk engineering systems to ensure reliable operation, security, and compliance with internal engineering standards and policies. Join on-call rotations, lead incident response, and drive thorough root-cause analysis Document data processes, detection workflows, and system configurations to support future development and maintenance. Use development and coding best practices (e.g., reusable, modular). Own end-to-end quality for the code you deliver, including testing and DevOps automation Skills Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience Candidates must be able to meet Microsoft, customer and/or government security screening requirements are required for this role The successful candidate must have an active U.S. Government Secret Security Clearance Ability to meet Microsoft, customer and/or government security screening requirements are required for this role Failure to maintain or obtain the appropriate clearance and/or customer screening requirements may result in employment action up to and including termination This position requires successful verification of the stated security clearance to meet federal government customer requirements You will be asked to provide clearance verification information prior to an offer of employment This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter This position requires verification of U.S. citizenship due to citizenship-based legal restrictions Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 5+ years experience in business analytics, data science, software development, data modeling, or data engineering OR equivalent experience 1+ year(s) experience with data governance, data compliance and/or data security Experience with security product usage such as Insider Risk Management or Sentinel Demonstrated ability to build and manage data systems in the cloud Experience with big data systems and tools, such as PySpark, Databricks, or Azure Synapse Familiar with data engineering best practices like layered data architecture, data modeling, and developing reliable and scalable data pipelines Strong understanding of engineering and security compliance standards, with experience in regulated environments Excellent problem-solving skills and attention to detail, with a proactive approach to identifying and mitigating risks Experienced working within agile frameworks such as Scrum and Kanban Benefits Certain roles may be eligible for benefits and other compensation. Company Overview Microsoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services. It was founded in 1975, and is headquartered in Redmond, Washington, USA, with a workforce of 10001+ employees. Its website is