I will help to build pyspark notebooks and optimize jobs

Alcune informazioni sono riportate in lingua inglese.
Soham Das

India

Parlo Inglese

4 ordini completati

Databricks, Unity Catalog, ADF, DLT

Tools I work with - Databricks, Unity Catalog, DLT, Azure, SQL What I help with: - Design and build ETL pipelines using Azure Data Factory and Databricks - Optimize slow or failing Spark and PySpark ...
Continua a leggere
Informazioni su questo servizio

Is your PySpark job taking hours? Is your SQL query timing out?

I will find exactly what's slowing it down and fix it.

I have optimized PySpark jobs processing billions of records in production environments. I know exactly where to look.


What I fix:

  • Slow PySpark transformations and actions
  • Partition skew and memory issues
  • Inefficient SQL queries on large datasets
  • Spark configuration tuning
  • DataFrame optimization and caching strategy


You share your code. I analyse, fix and explain exactly what was wrong and why.

Message me first with your problem. I will tell you honestly if I can help.

Continua a leggere
help to build pyspark notebooks and optimize jobs
Schermo intero
help to build pyspark notebooks and optimize jobs
Schermo intero
help to build pyspark notebooks and optimize jobshelp to build pyspark notebooks and optimize jobs

Lingua:

Inglese

Esperienza tecnica:

Apache Spark

•

Databricks

•

Altro

Expertise:

Pipeline dati

•

Sviluppo ETL

•

Data warehousing

•

Altro

Settore:

Analisi dei dati

Tag correlati