b
balajiyadav855

Balaji

@balajiyadav855

Azure Data Engineer

India
Inglese, Telugu, Hindi
Alcune informazioni sono riportate in lingua inglese.
Chi sono
I am an Azure Data Engineer with 3 years of experience in Azure Databricks, PySpark, Apache Spark, SQL, Azure Data Factory, ADLS Gen2, Delta Lake, Unity Catalog, Structured Streaming, and Azure DevOps. I build end-to-end ETL/ELT pipelines, perform data ingestion and transformation, implement incremental loads and Delta MERGE, optimize Spark jobs, and troubleshoot production issues. I have experience with Bronze, Silver, and Gold architectures, data governance, CI/CD, pipeline orchestration, monitoring, and delivering curated data for downstream applications and reporting.... Continua a leggere

Competenze

b
balajiyadav855
Balaji
offline • 
Tempo di risposta medio: 1 ora

Consulta i miei servizi

Consulenza Data engineering
I will build azure databricks pyspark and adf etl data pipelines

Esperienza lavorativa

Cognizant

Azure Data Engineer

Cognizant • Full time

Oct 2022 - Jun 20263 yrs 8 mos

I worked as an Azure Data Engineer at Cognizant for around 4 years, developing and maintaining end-to-end ETL pipelines. My work involved Azure Data Factory for orchestration, Azure Databricks with PySpark and SQL for data transformation, and ADLS Gen2 and Delta Lake for storage. I handled data ingestion, incremental loads, data validation, Spark performance optimization, pipeline monitoring, troubleshooting, and production support. I also worked with Medallion Architecture, Unity Catalog, Structured Streaming concepts, and CI/CD using Azure DevOps.