
WangKun
Python Web Scraping and Data Extraction Specialist
Competenze

Consulta i miei servizi

Esperienza lavorativa
Web Scraping & JS Reverse Engineering Expert
Self Employed • Freelance
May 2024 - Present • 2 yrs 2 mos
Scraper System Architecture: Designed and developed the company's core book data collection system; built distributed scrapers based on the Scrapy framework to achieve highly efficient and stable crawling of target book websites. Anti-Scraping Circumvention (JS Reverse Engineering): Conducted in-depth analysis of target websites' anti-scraping mechanisms; performed JS reverse engineering (including decrypting request parameters, cracking obfuscated code, and analyzing Cookie generation logic) to successfully bypass high-difficulty firewalls and ensure data continuity and integrity. API & Frontend Display: Developed high-performance, stable backend API interfaces using the Flask framework, seamlessly delivering cleaned book data to the frontend for visual display, enabling clients and internal teams to view data intuitively. Performance Optimization: Optimized scraper concurrency strategies and data ingestion workflows, significantly boosting crawling efficiency and guaranteeing real-time updates for massive book datasets.