I will build a databricks pyspark etl pipeline

Alcune informazioni sono riportate in lingua inglese.

Pakistan

Parlo Inglese, Urdu

Python and Data Engineer Web Scraping ETL Pipelines SQL AI Video Genrator

CS student at FUUAST Karachi, specializing in Python, SQL & Data Engineering I help businesses with: ✅ Web Scraping & Data Extraction ✅ ETL Pipelines (Extract, Transform, Load) ✅ Data Cleaning & Anal...
Informazioni su questo servizio

Have raw data stuck in CSV files, APIs or messy tables? I'll turn it into clean, analytics-ready tables using Databricks, PySpark and Delta Lake with the Medallion (Bronze, Silver, Gold) architecture.


What you get:

Bronze layer: raw data ingested safely, nothing lost

Silver layer: cleaned, deduplicated and standardized data

Gold layer: business-ready tables for reports and dashboards

Well-commented PySpark and SQL notebooks

Data quality checks (nulls, duplicates, wrong formats)

Simple documentation so your team can maintain it


My proof: I built an end-to-end Databricks project that processed over 51,000 records through all three Medallion layers. I'm a micro1 Certified Data Engineer with Cloud Data Engineer training (Python, SQL, AWS, Snowflake, Spark).


Note: the pipeline runs in YOUR Databricks workspace so you own your data. A free Databricks account is enough for small projects.


Message me before ordering with your data source and goal, and I'll recommend the right package.

Lingua:

Inglese

Esperienza tecnica:

dbt (Data Build Tool)

•

Apache Airflow

Expertise:

Pipeline dati

•

Sviluppo ETL

•

Data warehousing

Settore:

Crypto e blockchain

•

Analisi dei dati

•

Servizi finanziari

Il mio portfolio

Altri servizi della categoria Data engineer offerti da me