I will build scalable databricks and pyspark etl data pipelines

Alcune informazioni sono riportate in lingua inglese.
4,9
4,9

India

Parlo Hindi, Inglese

16 ordini completati

Databricks Data Engineer, Azure Certified Architect, Data Expert, Cloud Security

Senior Data Engineer & Azure Certified Architect with 11+ years of experience delivering scalable enterprise data solutions. I transform raw data into business success stories. Core Expertise: * Data...
Informazioni su questo servizio

Looking for a Senior Data Engineer to build high-performance data solutions? You are in the right place!

With 11+ years of enterprise experience and official cloud certifications, I specialize in designing robust data pipelines that process massive datasets with minimal latency and optimized cloud costs.

My Core Services:


* ETL/ELT Pipelines: Automated data ingestion from APIs, databases, and cloud storage.

* PySpark & SparkSQL: Modular Databricks notebooks for complex data cleansing and normalization.

* Performance Tuning: Debugging slow Spark jobs, query tuning, and cluster optimization.

* Data Warehousing: Implementing Medallion architectures and dynamic upsert logic.


Technical Stack:

Apache Spark | PySpark | Databricks | Azure Data Factory | Azure Synapse | Hive | SparkSQL | SQL Server

My Handoff Process:


  1. Deep requirement analysis and architectural alignment.

  2. Writing clean, production-ready code with testing.

  3. Revisions and fine-tuning based on your feedback.

  4. Detailed documentation and walkthrough.


Please message me via chat to discuss your requirements before placing an order!



Expertise:

Amministrazione Cloud

Network e sicurezza

Provider Cloud:

microsoft azure

Il mio portfolio

Recensioni

9 recensioni per questo servizio
4,9

(9)
(0)
(0)
(0)
(0)
Valutazione dettagliata
  • Livello di comunicazione del venditore
    5
  • Qualità della consegna
    5
  • Valore della consegna
    4,8
Ordina per
Più rilevante
  • L

    latenightmirage

    AE

    Emirati Arabi Uniti

    4,7

    i am extremely happy with the result of the work he provided me with. the code was free of bugs and easy to understand. although i presented him with last minute work he was able to handle the time constraint. my only complaint would be it was a bit pricy, but other than that it was such a pleasure working...

    100 USD-200 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
  • B

    buntuspec

    US

    Stati Uniti

    5

    Good attention to details and thorough debugging

    50 USD-100 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
  • M

    mrmiyagi24

    US

    Stati Uniti

    5

    It was good working with TS.

    100 USD-200 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
  • A

    agbodikethomas

    Cliente abituale

    US

    Stati Uniti

    5

    Professional

    Fino a 50 USD

    Prezzo

    5 giorni

    Tempo

    Utile?
    No
  • A

    agbodikethomas

    Cliente abituale

    US

    Stati Uniti

    5

    Professional

    50 USD-100 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
Recensioni

9 recensioni per questo servizio
4,9

(9)
(0)
(0)
(0)
(0)
Valutazione dettagliata
  • Livello di comunicazione del venditore
    5
  • Qualità della consegna
    5
  • Valore della consegna
    4,8
Ordina per
Più rilevante
  • L

    latenightmirage

    AE

    Emirati Arabi Uniti

    4,7

    i am extremely happy with the result of the work he provided me with. the code was free of bugs and easy to understand. although i presented him with last minute work he was able to handle the time constraint. my only complaint would be it was a bit pricy, but other than that it was such a pleasure working...

    100 USD-200 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
  • B

    buntuspec

    US

    Stati Uniti

    5

    Good attention to details and thorough debugging

    50 USD-100 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
  • M

    mrmiyagi24

    US

    Stati Uniti

    5

    It was good working with TS.

    100 USD-200 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No
  • A

    agbodikethomas

    Cliente abituale

    US

    Stati Uniti

    5

    Professional

    Fino a 50 USD

    Prezzo

    5 giorni

    Tempo

    Utile?
    No
  • A

    agbodikethomas

    Cliente abituale

    US

    Stati Uniti

    5

    Professional

    50 USD-100 USD

    Prezzo

    1 giorno

    Tempo

    Utile?
    No