Senior Scraping Infrastructure Engineer

Onhires Inc.

Job Overview

Location

Peru

Job Type

Full-time

Full Job Description

📋 Description

• As a Senior Scraping Infrastructure Engineer at Onhires Inc., you will play a critical role in enabling the company’s mission to deliver cutting-edge market intelligence to the automotive industry by architecting and maintaining resilient, large-scale data extraction systems that bypass sophisticated anti-bot mechanisms and ensure high-quality, real-time data collection at scale.
• Your work will directly impact the reliability and scalability of the core data pipeline, empowering business decisions with accurate, timely insights while operating within a remote-first, international scale-up environment that values technical excellence and ownership.
• Day to day, you will architect, build, and maintain the core infrastructure for massive, large-scale asynchronous data extraction systems, ensuring they are fault-tolerant, scalable, and optimized for performance under high load and dynamic web conditions.
• You will design, implement, and continuously optimize advanced anti-blocking strategies including IP rotation, browser fingerprint management, CAPTCHA solving techniques, and proxy rotation to evade detection and maintain consistent uptime against modern web defenses.
• You will implement robust monitoring, alerting, and logging systems using industry-standard tools to proactively detect anomalies, debug failures, and continuously improve scraper performance, data quality, and system reliability across all pipelines.
• You will develop, test, and deploy highly robust and fault-tolerant web scraping components using Python-based tools such as Scrapy, Playwright, Selenium, and Requests, adhering to best practices in code quality, testing, and maintainability.
• You will manage and automate high-volume data ingestion pipelines, ensuring seamless integration with internal microservices and external REST APIs, while optimizing data flow, transformation, and storage for downstream consumption.
• You will drive DevOps best practices by managing infrastructure via Docker, contributing to CI/CD pipeline design and execution, and leveraging Nomad (as a plus) for orchestration, ensuring reproducible, scalable, and observable deployments.
• You will collaborate closely with cross-functional engineers to establish technical standards, improve core tooling, and mentor junior team members, fostering a culture of knowledge sharing and technical excellence.
• You will take full ownership of critical infrastructure projects from conception to production, making strategic decisions that balance innovation, reliability, and operational efficiency in a fast-paced, growth-oriented environment.
• The team is a small, international, and highly skilled group based in Berlin but operating remotely, united by a passion for solving complex data challenges in the automotive intelligence space, where innovation and technical depth are highly valued.
• In this role, you will deepen your expertise in advanced web scraping techniques, anti-bot evasion, distributed systems, and DevOps automation, positioning yourself as a specialist in high-stakes data infrastructure while contributing meaningfully to a scale-up with global impact.

🎯 Requirements

• Proven, hands-on professional experience in high-volume web scraping and data extraction using Python, including building and maintaining production-grade scraping systems at scale.
• Deep, practical knowledge of anti-bot solutions, including CAPTCHA solving mechanisms, browser fingerprinting techniques, and effective proxy/IP rotation strategies to evade detection and maintain scraping reliability.
• Solid understanding of HTML parsing, browser automation (Playwright, Selenium), asynchronous programming (asyncio), and REST API integration for robust data ingestion pipelines.
• Proficiency with leading web scraping frameworks such as Scrapy, Playwright, or Selenium, and experience working with both SQL and NoSQL databases for efficient data storage and retrieval.
• Experience with Docker, Linux environments, Git version control, and CI/CD pipelines; familiarity with Nomad is a plus.
• Fluent in English (written and spoken) to collaborate effectively in an international, remote-first team.

🏖️ Benefits

• High degree of freedom and ownership: Opportunity to make a meaningful, measurable impact on a growing scale-up business with autonomy over technical decisions and infrastructure direction.
• Full remote flexibility: Work from anywhere as part of a remote-first company that actively supports distributed teams and asynchronous collaboration.
• Competitive compensation and growth support: Access to ongoing training, coaching, and professional development resources to advance your technical and leadership skills.
• Collaborative international team: Join a small, talented, and diverse group of engineers in a supportive, innovation-driven atmosphere with strong engineering culture.
• Optional office access: Availability to work from a modern office at Wildau Tech University campus near Berlin, easily accessible by public transport, for those who prefer hybrid arrangements.

Skills & Technologies

Python

Docker

Git

Linux

REST

Backend

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Onhires Inc.

Visit Website

About Onhires Inc.

Onhires is a talent acquisition platform designed to streamline the hiring process for businesses. It offers a comprehensive suite of tools that automate and optimize various stages of recruitment, from sourcing candidates to onboarding new hires. The platform aims to reduce time-to-hire and improve the quality of hires by leveraging intelligent automation and data-driven insights. Key features include applicant tracking, candidate sourcing, interview scheduling, and performance analytics, all integrated into a user-friendly interface. Onhires serves companies seeking to enhance their recruitment efficiency and build stronger teams by making the hiring journey more effective and less resource-intensive.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.