[Remote] Big Data Architect-W2 only
Note: The job is a remote job and is open to candidates in USA. Intellectt Inc is seeking a Big Data Architect/Data Pipeline Engineer. The role involves designing and building scalable data pipelines and big data architectures, while ensuring data quality, security, and governance standards. Responsibilities • Design and build scalable data pipelines and big data architectures • Develop and optimize Databricks-based data solutions • Implement data integration, processing, and storage solutions • Ensure data quality, security, and governance standards • Optimize solutions for performance, scalability, and cost • Collaborate with stakeholders to translate business needs into technical solutions Skills • Databricks (Python, SQL, PySpark) • Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs) • Data Modeling and ETL/ELT design patterns • Data Engineering (enterprise-scale) • Performance tuning and scalability • 7+ years of enterprise data engineering experience • Strong experience with large-scale data pipelines and architectures • Healthcare data integration experience is a must • Data harmonization and normalization at scale • Docker and Azure Kubernetes Service (AKS) Company Overview • We advance technology with purpose - empowering enterprises move confidently into the future. It was founded in 2018, and is headquartered in Iselin, New Jersey, USA, with a workforce of 1001-5000 employees. Its website is Apply tot his job