Sfoglia categorie
Esplora
Fiverr Pro
Italiano
$
USD
I will create airflow dags and pyspark workflows for etl pipelines
Data Engineer, PySpark, Airflow, ETL ELT, Databricks, Azure, AWS
A Data Engineer specializing in building clean, scalable, and automated data pipelines. I help businesses transform raw data into analytics-ready, reliable, and high-quality datasets using modern engi...
Informazioni su questo servizio
Airflow & PySpark Data Engineering Expert for Your Project Needs
Looking to automate your data workflows, build reliable pipelines, and unlock insights from raw data? Im here to help! With hands-on experience in modern data engineering and multiple successful project deliveries, I specialize in building efficient, scalable, and production-ready data solutions.
Services Offered
- Data Pipeline Development using Apache Airflow & PySpark
- ETL / ELT Workflows: extract transform load using Spark
- Data Cleaning & Processing: scalable batch transformations
- Pipeline Orchestration: scheduling, retries, logging, alerts
- Cloud Integration: AWS/S3 or Docker-based environments
- Project Planning & Technical Consultation
Why Choose Me?
- Airflow & PySpark Specialist: strong expertise in modern data engineering tools
- Efficient & Automated Workflows: optimized, reliable, and scalable pipelines
- Clean Code + Documentation: clear structure and maintainable design
- Strong Technical Skills: Python, Spark, Airflow, Docker, cloud storage
- Professional Delivery: I can work independently or collaborate with your team
FAQ
What do you need from me to get started?
I need a brief description of your data sources, desired workflow, file formats, and any tools or environments you already use (Airflow setup, Spark cluster, S3/MinIO, etc.).
Do you set up Airflow or Spark from scratch?
Yes! I can set up Airflow and PySpark locally or using Docker. If you already have an environment, I can integrate my work into it.
Will you document the pipeline?
Yes, every package includes clean, easy-to-understand documentation. Premium includes an architecture diagram as well.
Can you maintain or update existing pipelines?
Yes, I can optimize, refactor, or extend your existing Airflow DAGs and PySpark workflows.
