I will build or fix your azure databricks and pyspark data pipelines
Azure Databricks and PySpark Data Engineer
Informazioni su questo servizio
Need a reliable pipeline on Azure Databricks, or one that keeps failing? I am an Azure Data Engineer with about 4 years of building production lakehouse pipelines on Databricks, PySpark, Azure Data Factory, Delta Lake and Unity Catalog.
What I do:
- New pipelines: ingest files, APIs or databases into Delta Lake (bronze, silver, gold)
- Fix failing notebooks, jobs and ADF pipelines
- Incremental loads, merges and upserts (SCD), schema evolution
- Data quality checks, logging and alerting
- Clear documentation so your team can run it
How we work: share your notebook or code and sample data (dummy data is fine), or give me least-privilege workspace access through your own admin. Please never send passwords or keys.
I use AI-assisted tooling, and every delivery is tested and documented by me.
Please message me before ordering so I can confirm scope and timeline.
Strumenti e piattaforme:
Azure data factory
FAQ
Do you need my Azure or Databricks password?
No. Share code and sample data, or have your admin give me a least-privilege user in your workspace. I never take passwords or keys.
Can you work on AWS or GCP instead of Azure?
Yes for Databricks and PySpark on any cloud. My deepest experience is Azure, so please message me first with your setup.
