
Vishal Gupta
Software Engineer
Competenze

Consulta i miei servizi


Esperienza lavorativa
DATA and AI Engineer
Tata Group • Full time
Jul 2023 - Present • 3 yrs
Designed and deployed data pipelines migrating 240+ GB across 34+ tables into Azure Data Lake (ADLS Gen2) using ADF and Databricks with zero data loss.– Built scalable Medallion architecture (Bronze–Silver–Gold) and optimized PySpark jobs, reducing processing time by ˜40%.– Implemented Snowflake as analytics layer using clustering and materialized views, improving query performance by ˜30%.– Developed CI/CD pipelines for ADF using Azure DevOps, enabling automated deployments and eliminating manual effort.– Engineered cross-cloud healthcare pipeline (GCP BigQuery to Azure to Snowflake) processing 10,000+ patient records.– Built Python + SQL data validation framework reducing production data issues by ˜60%.– Delivered GenAI-based analytics assistant using LangChain for natural language querying, reducing analyst turnaround time by ˜50%.