Web Scraping Engineer

📋 Description

• • As a Web Scraping Engineer at YipitData, you will design, build, and maintain robust web scrapers that power critical reports and customer experiences across the organization, directly influencing strategic decisions for major investment funds and corporations.
• • Your day-to-day responsibilities include refactoring and maintaining existing scraping scripts for improved reliability and efficiency, implementing advanced scraping techniques such as fingerprinting and proxy rotation to avoid detection, collaborating with analysts and stakeholders to gather requirements and ensure data quality, developing monitoring and alerting systems to quickly identify and address failures, and driving continuous improvement by proposing new tooling and staying current with evolving bot-detection tactics.
• • YipitData is a leading market research and analytics firm backed by The Carlyle Group, analyzing billions of alternative data points daily to deliver insights on ridesharing, e-commerce, payments, and more. The company operates globally with offices in major cities across the US, Asia, and Europe, and fosters a people-centric culture focused on mastery, ownership, and transparency, recognized as one of Inc’s Best Workplaces for three consecutive years.
• • In this role, you will gain deep expertise in large-scale web data extraction, contribute to high-impact data products used by Fortune 500 companies, shape the processes and culture of an expanding engineering team, and advance your skills in modern scraping frameworks, performance optimization, and resilient system design while working remotely from India with flexible hours.