[Remote] Independent Contractor, Data Engineer, Business Operations
Note: The job is a remote job and is open to candidates in USA. Vaniam Group is seeking a hands-on Data Engineer to partner with Business Operations in building a reliable, scalable data foundation. The role involves centralizing operational data, developing automated pipelines, and laying the groundwork for advanced data use cases to enhance decision-making across the organization.
Responsibilities
ā¢ Stand up a scalable Databricks lakehouse to ingest, model, and serve business operations data (finance, resourcing, project delivery, CRM, marketing, and time tracking)
ā¢ Design and maintain automated ELT/ETL pipelines that move data from SaaS tools, databases, and files into bronze/silver/gold layers
ā¢ Build the core semantic layer (cleaned, conformed, documented tables) that powers self-serve BI and executive dashboards
ā¢ Replace legacy/manual engagement and utilization reports with scheduled, monitored jobs and SLAs
ā¢ Partner with Business Operations, Finance, and People Operations leaders to define source-of-truth metrics (e.g., revenue, margin, utilization, velocity, pipeline, engagement health)
ā¢ Lay groundwork for AI use cases (RAG over operational data, agentic processes, querying company data) by implementing robust lineage, metadata, and access controls
ā¢ Architecture & Modeling: Design lakehouse architecture, dimensional/medallion models, and data contracts across systems
ā¢ Pipeline Automation: Implement CI/CD for data (branching, PRs, jobs, environments), with observability and reproducibility
ā¢ Data Governance: Enforce PII/PHI handling, role-based access, auditability, and retention aligned to healthcare-adjacent standards
ā¢ Enablement: Document datasets, publish a data catalog, and enable self-serve usage via BI and SQL
ā¢ Reporting Modernization: Decommission manual spreadsheets and one-off extracts; consolidate to certified, scheduled outputs
ā¢ AI Readiness: Capture lineage/metadata and vector-friendly document stores to support future ML and RAG initiatives
Skills
ā¢ 2+ years in data engineering or analytics engineering, including building production data pipelines at scale
ā¢ Expert with Databricks (Delta Lake, SQL, PySpark) and cloud data platforms (AWS or Azure)
ā¢ Proficient with dbt and/or Delta Live Tables; strong SQL and data modeling fundamentals
ā¢ Experience orchestrating jobs (Airflow, Databricks Workflows, or equivalent)
ā¢ Comfortable with PowerBI and semantic modeling for self-serve analytics
ā¢ Strong stakeholder skills. Can translate business needs into reliable data products and clear SLAs
ā¢ Familiarity with data governance (RBAC/ABAC, secrets management, token-based auth) and healthcare-adjacent compliance (e.g., HIPAA concepts) is a plus
ā¢ Databricks, Delta Lake, PySpark, SQL, dbt, REST/GraphQL APIs, Git/GitHub, Power BI/Tableau/Looker
Company Overview
ā¢ Vaniam Group offers consulting, scientific communication, expert engagement & insights-gathering services within the oncology field. It was founded in 2007, and is headquartered in Chicago, Illinois, USA, with a workforce of 201-500 employees. Its website is https://vaniamgroup.com/.
Apply Now
Apply Now
Responsibilities
ā¢ Stand up a scalable Databricks lakehouse to ingest, model, and serve business operations data (finance, resourcing, project delivery, CRM, marketing, and time tracking)
ā¢ Design and maintain automated ELT/ETL pipelines that move data from SaaS tools, databases, and files into bronze/silver/gold layers
ā¢ Build the core semantic layer (cleaned, conformed, documented tables) that powers self-serve BI and executive dashboards
ā¢ Replace legacy/manual engagement and utilization reports with scheduled, monitored jobs and SLAs
ā¢ Partner with Business Operations, Finance, and People Operations leaders to define source-of-truth metrics (e.g., revenue, margin, utilization, velocity, pipeline, engagement health)
ā¢ Lay groundwork for AI use cases (RAG over operational data, agentic processes, querying company data) by implementing robust lineage, metadata, and access controls
ā¢ Architecture & Modeling: Design lakehouse architecture, dimensional/medallion models, and data contracts across systems
ā¢ Pipeline Automation: Implement CI/CD for data (branching, PRs, jobs, environments), with observability and reproducibility
ā¢ Data Governance: Enforce PII/PHI handling, role-based access, auditability, and retention aligned to healthcare-adjacent standards
ā¢ Enablement: Document datasets, publish a data catalog, and enable self-serve usage via BI and SQL
ā¢ Reporting Modernization: Decommission manual spreadsheets and one-off extracts; consolidate to certified, scheduled outputs
ā¢ AI Readiness: Capture lineage/metadata and vector-friendly document stores to support future ML and RAG initiatives
Skills
ā¢ 2+ years in data engineering or analytics engineering, including building production data pipelines at scale
ā¢ Expert with Databricks (Delta Lake, SQL, PySpark) and cloud data platforms (AWS or Azure)
ā¢ Proficient with dbt and/or Delta Live Tables; strong SQL and data modeling fundamentals
ā¢ Experience orchestrating jobs (Airflow, Databricks Workflows, or equivalent)
ā¢ Comfortable with PowerBI and semantic modeling for self-serve analytics
ā¢ Strong stakeholder skills. Can translate business needs into reliable data products and clear SLAs
ā¢ Familiarity with data governance (RBAC/ABAC, secrets management, token-based auth) and healthcare-adjacent compliance (e.g., HIPAA concepts) is a plus
ā¢ Databricks, Delta Lake, PySpark, SQL, dbt, REST/GraphQL APIs, Git/GitHub, Power BI/Tableau/Looker
Company Overview
ā¢ Vaniam Group offers consulting, scientific communication, expert engagement & insights-gathering services within the oncology field. It was founded in 2007, and is headquartered in Chicago, Illinois, USA, with a workforce of 201-500 employees. Its website is https://vaniamgroup.com/.
Apply Now
Apply Now