Sfoglia categorie
Esplora
Fiverr Pro
Italiano
$
USD
Shivanesan S
@hardshiva
GCP Data Engineer
India
Inglese
Chi sono
I am a Google Certified Data Engineer with 3+ years of experience designing and implementing scalable data engineering solutions on Google Cloud Platform. I have expertise in building end-to-end ETL pipelines and optimizing data processing workflows.
Competenze
Shivanesan S
offline •
Tempo di risposta medio: 1 ora
Consulta i miei servizi
Consulenza Data engineering
I will do data engineering, etl pipeline orchestration, and data architecture
Esperienza lavorativa
Data Engineer
Randstad Singapore • Full time
Feb 2023 - Present • 3 yrs 3 mos
Scalable ML Pipelines: Designed and optimized scalable ETL/ELT pipelines using Apache Airflow and BigQuery, integrating Vertex AI to automate the training and deployment of predictive models on operational data. Developed automated data ingestion workflows using Google Cloud Storage, Bigquery, and Dataproc, reducing manual intervention and increasing pipeline reliability by 40% Predictive Insights: Built responsive web applications (POC) using Next.js and Python, integrating LLM-powered search and Generative AI features to provide stakeholders with natural language queries for real-time operational insights. Optimized PySpark jobs and SQL queries in BigQuery, improving data processing performance and reducing computational costs by 70% Implemented data quality monitoring dashboards and automated testing procedures, ensuring data accuracy and pipeline stability Cross-Functional Collaboration: Collaborated with Data Science teams to translate complex business requirements into scalable technical solutions, leveraging Google Cloud Vertex AI for model versioning and lifecycle management.
