Sfoglia categorie
Esplora
Fiverr Pro
Italiano
$
USD
Sembra che questo servizio sia in sospeso
I will build data pipelines ,AWS , airflow
India
Parlo Hindi, Inglese
Senior Data Engineer ,Spark ,Scala ,AWS ,Airflow , Kafka ,Big Dat
I’m Pankaj, a Data Engineer with 3+ years of experience building large-scale data pipelines, ETL workflows, and cloud data platforms. I specialize in Spark (Scala/PySpark), Airflow, Kafka, SQL, and AW...
Informazioni su questo servizio
Are you looking for a reliable Data Engineer to build or fix your ETL pipelines?
Im Pankaj, a Data Engineer with 3+ years of experience at Paytm, where I built 200+ production pipelines processing 5 TB/day using Spark, Airflow, AWS, and Kafka.
I can help you with:
- Building end-to-end ETL / ELT pipelines
- Spark (Scala / PySpark) data processing
- Kafka-based streaming pipelines
- Airflow DAG development & automation
- AWS (S3, EMR, Glue, Lambda, Athena)
- Data modeling & transformation
- Pipeline optimization (runtime + cost reduction)
What you will get:
- Clean, scalable, production-ready code
- Architecture design + documentation
- Continuous communication & fast delivery
Lets build a reliable data pipeline for your business.
FAQ
What technologies do you use?
Spark (Scala/PySpark), Kafka, Airflow, AWS (S3, EMR, Glue, Lambda), SQL, Python, Scala.
Can you connect to my database or API?
Yes — I can integrate MySQL, PostgreSQL, MongoDB, APIs, S3, and other sources.
Do you provide architecture consulting?
Yes, I provide pipeline architecture diagrams and best practices.
Can you optimize an existing slow Spark job?
Absolutely — I have reduced Spark runtimes by 45% and EMR costs by 20%.
Can we sign an NDA?
Yes, I can work under an NDA for sensitive data.
