Data Engineer with AWS Databricks Job at VDart Inc, Eagan, MN

ZytHUFhTQktYNENQelpiMURXOEtpOVZaaGc9PQ==
  • VDart Inc
  • Eagan, MN

Job Description

Role: Data Engineer Healthcare (AWS Databricks).

Location: Eagan, MN (Onsite).

Duration: Long Term Contract.

Overview:

  • Seeking an experienced Data Engineer with strong healthcare domain expertise and proficiency in AWS-native services, Databricks, SQL, and PySpark. This role involves designing and orchestrating ETL/ELT pipelines, leveraged through Databricks Workspace and Medallion Architecture, to support robust, compliant healthcare data transformation initiatives.

Key Responsibilities:

  • Build complex ETL/ELT pipelines using Databricks Workspace and PySpark, ensuring secure processing of sensitive healthcare data.
  • Architect and optimize solutions using Databricks Medallion Architecture and AWS data stack (e.g., S3, Glue, Redshift).
  • Orchestrate jobs via Databricks Workspace for seamless workflow automation.
  • Leverage Data Vault 2.0 methodologies in pipeline design (preferred but not mandatory).
  • Collaborate on data migration projects as needed.
  • Write advanced SQL queries for data analysis and transformation tasks.
  • Ensure compliance with security and healthcare data governance standards.
  • Engage with cross-functional teams to deliver scalable, reliable healthcare analytics solutions.

Required Skills & Experience:

  • Healthcare data engineering experience (mandatory).
  • Advanced SQL proficiency.
  • Experience with AWS native services and Databricks development (using AWS or equivalent cloud stack).
  • Strong PySpark and pipeline orchestration capability.
  • Familiarity with Databricks Medallion Architecture.
  • Exposure to Data Vault 2.0 methodologies.
  • Data migration project experience (preferred).
  • Strong communication and collaboration skills.

Job Tags

Long term contract,

Similar Jobs