I will build scalable databricks and pyspark etl data pipelines

Looking for a Senior Data Engineer to build high-performance data solutions? You are in the right place!

With 11+ years of enterprise experience and official cloud certifications, I specialize in designing robust data pipelines that process massive datasets with minimal latency and optimized cloud costs.

My Core Services:

* ETL/ELT Pipelines: Automated data ingestion from APIs, databases, and cloud storage.

* PySpark & SparkSQL: Modular Databricks notebooks for complex data cleansing and normalization.

* Performance Tuning: Debugging slow Spark jobs, query tuning, and cluster optimization.

* Data Warehousing: Implementing Medallion architectures and dynamic upsert logic.

Technical Stack:

Apache Spark | PySpark | Databricks | Azure Data Factory | Azure Synapse | Hive | SparkSQL | SQL Server

My Handoff Process:

  1. Deep requirement analysis and architectural alignment.

  2. Writing clean, production-ready code with testing.

  3. Revisions and fine-tuning based on your feedback.

  4. Detailed documentation and walkthrough.

Please message me via chat to discuss your requirements before placing an order!