
Mukund D
Data Engineer
Competenze

Consulta i miei servizi

Portfolio
Esperienza lavorativa
Data Engineer (In)
Airtel India • Full time
Jun 2026 - Aug 2026 • 2 mos
• Configured Kafka ingestion filters in Apache Pinot to enforce a 90-day data cutoff and converted time-based columns to epoch format for downstream analytics. • Optimized Apache Pinot SQL queries using time-range filtering and selective column retrieval to support low-latency analytics on high-volume event data. • Load-tested Apache Pinot using JMeter with 500 concurrent threads, achieving approximately 2,800 requests/sec at 180 ms average latency with 0% errors during a 1-hour test. • Built Grafana dashboards to monitor query latency, throughput, and system health, improving visibility into performance bottlenecks during load testing
Data Engineer (In)
Grant Thornton • Full time
Jul 2025 - Sep 2025 • 2 mos
• Optimized PySpark jobs using partition tuning, caching, Adaptive Query Execution (AQE), and broadcast joins, reducing runtime from 4 hours to 2.4 hours (40%). • Implemented Delta Lake partitioning and Z-Ordering on Databricks to improve data skipping and accelerate analytical queries. • Applied data skew mitigation using salting and strategic caching to improve Spark job execution efficiency. • Developed Databricks notebooks for large-scale financial ETL, tuning cluster configurations and join strategies to improve resource utilization and processing efficiency.