- Lisbon, Lisbon District, Portugal
- Senior
- 3+ years
Own and develop the scraping of Mercado Livre and other marketplaces, build and maintain distributed crawlers, monitor anti-bot defenses, reverse engineer private APIs, and use LLMs to solve data acquisition challenges.
Compensation
Compensation package: base salary and performance-based bonuses
Responsibilities
- Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee
- Build and maintain distributed crawlers running in production
- Monitor target marketplaces for changes, detect them early and update bypass logic proactively
- Reverse engineer private APIs to get data faster and more reliably than through HTML
- Keep crawlers scalable and observable: distributed queues, success-rate monitoring, alerting on anti-bot regressions
Requirements
- Nice to have: Direct experience with Mercado Livre
- Nice to have: Amazon
- Nice to have: Shopee
- Nice to have: TikTok Shop
- Nice to have: Public GitHub