I will build databricks delta lake lakehouse and medallion architecture

J
jesseantony
J
jesseantony
Jessay
Alcune informazioni sono riportate in lingua inglese.

Informazioni su questo servizio

Are you looking to build a modern, scalable data lakehouse on Databricks? I will design and implement a production-ready Delta Lake Lakehouse with Medallion Architecture (Bronze, Silver, Gold layers).


With 4+ years of experience at Publicis Sapient and Alcon building enterprise data platforms, I bring deep expertise in Databricks, PySpark, and Delta Lake.


What I will build for you:

  • Delta Lake setup with optimized Bronze/Silver/Gold medallion layers
  • PySpark pipelines for ingestion, transformation, and aggregation
  • Delta Live Tables (DLT) for declarative, auto-scaling pipelines
  • Unity Catalog for fine-grained data governance and access control
  • Data quality checks, schema enforcement, and ACID transactions
  • ML feature store integration for machine learning workflows
  • Performance tuning: Z-ordering, partitioning, and file compaction
  • Automated workflows using Databricks Jobs and clusters
  • Full documentation and handover


Technologies: Databricks, PySpark, Delta Lake, Delta Live Tables, Unity Catalog, Azure Data Lake Storage, Apache Spark, SQL


Message me to discuss your requirements!

Scopri di più su Jessay

Jessay

Senior Data Engineer: AWS, Azure, Spark, ETL Pipelines and Data Architecture

  • DaIndia
  • Membro daapr 2025
  • Tempo di risposta medio3 ore
  • Ultima consegna4 mesi
  • Lingue

    Malayalam, Inglese
Struggling with slow pipelines or messy data? I design and build scalable ETL pipelines that deliver real results. With 5+ years on AWS and Azure, I specialize in Databricks, Apache Spark, AWS Glue, and Azure Data Factory. I have built production-grade data warehouses, optimized Spark performance, and integrated Hadoop, Hive, and HBase environments. Stack: Python, PySpark, Scala, SQL, S3, Lambda, Step Functions, Azure Data Lake Gen2, Redshift, PostgreSQL. Ready to turn your raw data into clean, actionable insights.

Il mio portfolio

Tag correlati