Web Scraping Specialist

📋 Description

• • The Web Scraping Specialist will join a specialized technical team at MLabs to build infrastructure that delivers massive amounts of web data for training advanced AI models, playing a critical role in enabling AI development through reliable, scalable data acquisition.
• • Day to day, the person will write, test, and refine high-performance code to extract data from complex online sources, manage pagination and dynamic content via AJAX, clean and format data for quality assurance, store and manage scraped data in databases, and monitor scraping infrastructure to ensure continuous, stable data flow.
• • The team operates a massive distributed crawler and manages complex pipelines for ingesting, segmenting, and annotating billions of data points including videos, transcripts, and audio files, working in a fast-paced, low-bureaucracy environment focused on technical excellence and rapid execution.
• • In this role, the person can deepen expertise in large-scale web scraping, distributed systems, and data engineering for AI, gain hands-on experience with cloud infrastructure and NoSQL databases, and contribute directly to the creation of training data for cutting-edge AI models while working autonomously in a high-output culture.