
John.d
Ex Alibaba Senior Data Expert and Full Stack Architect
Competenze

Consulta i miei servizi

Esperienza lavorativa
Data R&D Specialist
Alibaba • Full time
Aug 2020 - Aug 2023 • 3 yrs
During my tenure at Alibaba, the world’s leading e-commerce and technology conglomerate, I served as a Senior Data Development Expert within the Data Middle Office (数据中台). I was responsible for architecting and maintaining ultra-large-scale data pipelines that processed petabytes of data daily, ensuring 99.9% data reliability for core business units. 【Key Responsibilities & Achievements】 Enterprise Data Middle Office Construction: Architected end-to-end data integration solutions. I led the design of reusable data assets (OneData methodology), reducing redundant data processing costs by 30% across multiple business lines. High-Concurrency ETL Pipeline Design: Developed and optimized complex ETL workflows using MaxCompute (ODPS) and DataWorks. Successfully managed data synchronization for high-traffic events (such as the Double 11 Global Shopping Festival), handling peak data surges of millions of events per second. Real-time Computing & Streaming: Implemented real-time data processing architectures using Flink and Kafka. Reduced data latency from hours to seconds for critical business dashboards, enabling real-time decision-making for marketing and supply chain teams. Data Modeling & Governance: Built standardized data warehouse models (Dimension Modeling). Established strict data quality monitoring systems and metadata management protocols to ensure high-accuracy business intelligence. Performance Tuning: Expertly optimized SQL queries and MapReduce/Spark jobs, significantly reducing computation resource consumption (CU) and shortening batch processing windows by over 40%.