I will develop scalable etl pipelines using pyspark, sql, databricks, and airflow

Are you looking for an expert data engineer to build or optimize your ETL pipelines? Look no further! Im a Data Engineer with 3.5+ years of experience in the US healthcare domain, specializing in developing scalable and efficient data pipelines.

What I Offer:

• ETL Pipeline Development: End-to-end pipelines using PySpark, SQL, and Azure Databricks.
• Data Integration: Seamless extraction from SQL Server, Kafka, DB2, and flat files.
• Cloud Migration: Move on-prem Hadoop-based pipelines to Azure for high performance.
• Data Transformation: Optimize data processing speed using PySpark and SQL.
• Data Storage: Implement Delta Lake solutions for robust storage and retrieval.
• Job Orchestration: Automate workflows with Airflow or Control-M.
• Data Modeling: Create data models with SqlDBM for healthcare and other domains.

Why Choose Me?

• Microsoft Certified Azure Data Engineer Associate (DP-203)
• Databricks Certified Data Engineer Associate
• Extensive experience with Azure Data Lake, Synapse, Data Factory
• Expertise in US healthcare data processes
• Proven record of delivering value with efficient ETL pipelines.