I will build databricks delta lake lakehouse and medallion architecture


Informazioni su questo servizio
Are you looking to build a modern, scalable data lakehouse on Databricks? I will design and implement a production-ready Delta Lake Lakehouse with Medallion Architecture (Bronze, Silver, Gold layers).
With 4+ years of experience at Publicis Sapient and Alcon building enterprise data platforms, I bring deep expertise in Databricks, PySpark, and Delta Lake.
What I will build for you:
- Delta Lake setup with optimized Bronze/Silver/Gold medallion layers
- PySpark pipelines for ingestion, transformation, and aggregation
- Delta Live Tables (DLT) for declarative, auto-scaling pipelines
- Unity Catalog for fine-grained data governance and access control
- Data quality checks, schema enforcement, and ACID transactions
- ML feature store integration for machine learning workflows
- Performance tuning: Z-ordering, partitioning, and file compaction
- Automated workflows using Databricks Jobs and clusters
- Full documentation and handover
Technologies: Databricks, PySpark, Delta Lake, Delta Live Tables, Unity Catalog, Azure Data Lake Storage, Apache Spark, SQL
Message me to discuss your requirements!
Scopri di più su Jessay
Senior Data Engineer: AWS, Azure, Spark, ETL Pipelines and Data Architecture
- DaIndia
- Membro daapr 2025
- Tempo di risposta medio3 ore
- Ultima consegna4 mesi
Lingue
Malayalam, Inglese
Il mio portfolio
FAQ
What cloud platforms do you support for Delta Lake?
I primarily work with Azure Databricks and Azure Data Lake Storage (ADLS Gen2), but also support AWS (S3 + EMR/Glue) and GCP (BigQuery + Dataproc). All packages include cloud-agnostic Delta Lake configuration.
Do I need an existing Databricks workspace to get started?
Not necessarily. I can help you set up a new Databricks workspace from scratch on your cloud account, or work within your existing environment. Just share your current setup when you reach out.
