Back to Home
Data / Backend
Movie Review Site Crawl Engine
Automated data collection platform for international TV dramas
Key Responsibilities
- Crawl infrastructure construction with Scrapy & Docker
Tech Stack
PythonDockerAWS
Infrastructure Strategy
☁️
Cloudflare⇄
▲
Vercel⇄
🗄️
API / DBBuilt data collection pipeline using AWS SQS, EMR, Hive, and DataPipeline.