Azure Data Engineer Job at Sansar Tec, Alaska

Z09HRldpRlBYNHVOekpMekNHb0VpdFpZaHc9PQ==
  • Sansar Tec
  • Alaska

Job Description

Role: Azure Data Engineer

Location: Mississauga, ON / Montreal, QC

3 Days Hybrid from Day 1

Must Have:

  • Snowflake
  • SQL
  • Python
  • ADF
  • Azure Data Bricks
  • PySpark
  • Data Warehouse Concepts

 

Job Description :

This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.

 

Major Responsibilities:

  • Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
  • Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
  • Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
  • Proficient in developing programs in Python and SQL
  • Experience with Data warehouse Dimensional data modeling.
  • Working with event based/streaming technologies to ingest and process data.
  • Working with structured, semi structured and unstructured data.
  • Optimize Databricks jobs for performance and scalability to handle big data workloads.
  • Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
  • Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
  • Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
  • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

 

Skills:

  • 9+ years Python coding experience.
  • 5+ years - SQL Server based development of large datasets
  • 5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
  • Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
  • Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
  • Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
  • Experience with Cloud based data architectures, messaging, and analytics.
  • Cloud certification(s).
  • Any experience with Airflow is a Plus.

background in Python, Pyspark, SQL and data warehousing for enterprise level systems

Job Tags

Full time,

Similar Jobs

Service Master clean

Housekeeper for Commercial Cleaning Company Kent Job at Service Master clean

 ...ServiceMaster Clean - [Room Attendant / Cleaner] As a Housekeeper at ServiceMaster Clean, you'll: Perform all cleaning duties for facilities using provided ServiceMaster products, tools and procedures; Perform cleaning duties to include sweeping, mopping, polishing, trash... 

Access Physical Therapy & Wellness

Clinic Director Job at Access Physical Therapy & Wellness

 ...Job Description Overview : Physical Therapist /Clinical Director Clinic Location: 4 Flowers Drive, Suite 1 Mechanicsburg, Pennsylvania Salary: $80,000/yr-$100,000/yr plus Profit Sharing Status FT (40hrs) HowACCESS PT and Wellness... 

iHealth Labs

On-Call Health Coach Job at iHealth Labs

Position Title On-Call Health CoachDepartment Clinical OutcomeWork Location Sacramento, CABase pay range $25.00/hr - $30.00/hrAbout...  ...health outcomes, and quality of lifeHost face-to-face and virtual coaching sessions to assist patients in setting and achieving... 

TriMech Services

Solidworks Mechanical Designer Job at TriMech Services

 ...and updates to existing systems and products. Key Responsibilities Develop detailed 3D models and 2D drawings using SOLIDWORKS CAD software. Support design activities for new product development and system improvements. Collaborate with the engineering... 

Ladgov Corporation

Chaplain Job at Ladgov Corporation

 ...Job Description Job Description Overview: The Local Facility Chaplain for the El Paso detention facility provides direct leadership for religious programs, including worship services, pastoral counseling, and religious education. This position also coordinates...