I will build databricks and pyspark etl pipelines with azure data factory
Data Engineer
Informazioni su questo servizio
Is your data stuck in APIs, files and databases, with no reliable way to get it into Azure for reporting?
I build automated ETL pipelines on Azure Data Factory and Databricks that ingest your data, clean it with PySpark and deliver analytics-ready tables for Power BI, on a schedule and with no manual work.
WHAT I BUILD
Azure Data Factory pipelines: REST APIs, files and databases into Azure Data Lake
Databricks notebooks in PySpark and Spark SQL
Delta Lake tables with Bronze / Silver / Gold (medallion) layers
Star-schema models and incremental loads, with no full reloads
Triggers, scheduling, logging and data quality checks
Power BI-ready outputs and clear documentation
SOURCES
REST APIs, CSV/Excel/JSON, SQL databases, Azure Blob and Data Lake storage
GOOD FOR
Startups and small teams moving to Azure who need a clean, working data layer.
WHY ME
I built this exact stack end to end during a data engineering internship: API ingestion, a Delta Lake star schema covering 20+ cities, and Power BI dashboards on top.
Message me first with your sources, data size and goal, and I'll confirm scope and a fixed price.
FAQ
Who pays for the Azure resources?
You do, through your own Azure subscription. I design the pipeline to keep costs low and tell you the expected usage before I start.
What access do you need?
A resource group or workspace where I can create Data Factory and Databricks items, plus read access to your sources. I never need access to anything unrelated.
What sources can you connect?
REST APIs, CSV/Excel/JSON files, SQL databases, and Azure Blob or Data Lake storage. Tell me your source and I’ll confirm it’s possible.
Can I run it myself afterwards?
Yes. It comes with documentation, and the Premium package includes a handover call so your team can run and extend it.
Do you work with Fabric or Snowflake?
Not in this gig. Message me first and I’ll tell you honestly whether it’s a fit.
Will it run automatically?
Yes. I set up Data Factory triggers on your schedule, with logging so failures are visible.

