
Rajrishi Charan
Enterprise data engineer building automated pipelines and optimizing SQL
Competenze

Consulta i miei servizi


Portfolio
Esperienza lavorativa
Data Engineer
Narayana Health • Full time
Aug 2026 - Present • 2 mos
Built and maintained production-grade ETL/ELT pipelines processing large-scale datasets. Experienced with Python, SQL, Apache Spark, Microsoft Fabric, Databricks, Snowflake, Trino, and Airflow. Developed pipelines capable of handling millions of records with incremental processing and automated workflows. Worked on 15+ production data workflows, improving pipeline reliability and operational consistency. Optimized data processing and SQL workloads, achieving 30–40% reductions in query execution time in previous projects. Built data pipelines processing 10M+ records daily using distributed data-processing technologies. Implemented data validation, reconciliation, data quality checks, and lineage tracking. Experienced in debugging complex pipeline issues involving duplicates, incremental loads, watermarks, schema/key changes, and data mismatches. Worked with Azure, Docker, Kubernetes, PostgreSQL, MongoDB, and SQL Server as part of broader data engineering workflows. Comfortable working with both batch and incremental data pipelines, from source ingestion to analytical tables and dashboards.
Data Engineer
Sigma Solve • Full time
Jan 2026 - Aug 2026 • 7 mos
Worked as a Data Engineering Intern building and maintaining scalable data pipelines using Python, Apache Spark, Databricks, Snowflake, Trino, and Airflow. • Built and optimized ETL/ELT pipelines processing 10M+ records daily. • Orchestrated 15+ production workflows using Apache Airflow. • Optimized SQL and data processing workloads, reducing query execution time by 30–40%. • Implemented data validation, quality checks, and lineage tracking to improve pipeline reliability. • Worked with Docker, Kubernetes, and Azure for containerized data workloads and deployments.
Software Developer Intern
AgritzFresh • Part time
Mar 2025 - Dec 2025 • 9 mos
During my internship at AGRIX, I developed backend systems and dashboards for IoT-enabled agricultural platforms, working with real-time telemetry, geospatial data, and analytics. This experience taught me how to build reliable, scalable applications that solve real operational problems and deliver meaningful insights to users.