I will build databricks and pyspark etl pipelines with azure data factory

Alcune informazioni sono riportate in lingua inglese.

Pakistan

Parlo Urdu, Inglese, Tedesco, Italiano

Data Engineer

I am a Software Engineering student who builds end-to-end data pipelines across Azure, ELT/ETL pipelines, Databricks, and open-source stacks. I specialize in medallion architecture, star-schema modeli...
Informazioni su questo servizio

Is your data stuck in APIs, files and databases, with no reliable way to get it into Azure for reporting?


I build automated ETL pipelines on Azure Data Factory and Databricks that ingest your data, clean it with PySpark and deliver analytics-ready tables for Power BI, on a schedule and with no manual work.


WHAT I BUILD

Azure Data Factory pipelines: REST APIs, files and databases into Azure Data Lake

Databricks notebooks in PySpark and Spark SQL

Delta Lake tables with Bronze / Silver / Gold (medallion) layers

Star-schema models and incremental loads, with no full reloads

Triggers, scheduling, logging and data quality checks

Power BI-ready outputs and clear documentation


SOURCES

REST APIs, CSV/Excel/JSON, SQL databases, Azure Blob and Data Lake storage


GOOD FOR

Startups and small teams moving to Azure who need a clean, working data layer.


WHY ME

I built this exact stack end to end during a data engineering internship: API ingestion, a Delta Lake star schema covering 20+ cities, and Power BI dashboards on top.


Message me first with your sources, data size and goal, and I'll confirm scope and a fixed price.

Destination Platform:

Databricks Lakehouse

•

PostgreSQL

•

MySQL

Strumenti e piattaforme:

Airbyte

•

Kafka Connect