Job Overview
Location
London
Job Type
Full-time
Category
Data Engineer
Date Posted
March 18, 2026
Full Job Description
đź“‹ Description
- • As a Data Engineer at Smarkets, you will play a critical role in transforming raw data from one of the world’s most sophisticated prediction markets into actionable insights that drive business decisions across sports, politics, and financial markets. Your work will directly impact how the company understands user behavior, optimizes trading systems, and delivers fair odds to over 200,000 global traders.
- • You will design, build, and maintain scalable ETL pipelines — both batch and real-time — using Python frameworks like Luigi or Airflow to ingest, transform, and load data from diverse sources including sports event feeds, payment systems, and user interaction logs into data warehouses such as AWS Redshift and Google BigQuery.
- • You will develop and productionize Flask/FastAPI-based REST services that expose data to internal teams and user-facing features, ensuring high reliability, low latency, and seamless integration with Postgres databases and Kubernetes orchestration.
- • You will collaborate with Data Science and Analytics teammates to operationalize machine learning models — including user segmentation, anomaly detection, and recommendation engines — by turning research prototypes into robust, monitored APIs served via the company’s Kubernetes cluster.
- • You will ensure the health and performance of Smarkets’ data lake by monitoring data quality, optimizing warehouse schemas, and implementing governance practices that support accurate reporting for stakeholders across product, marketing, finance, and executive teams.
- • You will participate in Agile ceremonies using Jira, contribute to code reviews, write comprehensive unit and integration tests, and help foster a culture of technical excellence through pair programming, knowledge sharing, and proactive problem-solving in a supportive, high-trust environment.
- • You will gain deep expertise in modern data infrastructure — including Kafka for event streaming, dbt for transformation orchestration, Prometheus/Grafana for monitoring, and Lightdash for BI — while working alongside engineers who use C++, Rust, and React in adjacent systems, giving you a rare full-stack view of a high-frequency trading-adjacent platform.
- • You will grow into a trusted technical contributor who not only executes tasks but also identifies opportunities to improve data reliability, reduce latency, and unlock new business value — positioning yourself for leadership roles within the Data team or broader engineering organization.
🎯 Requirements
- • 3+ years of professional experience in data engineering, ETL development, or related software engineering roles
- • Proficiency in Python with hands-on experience building ETL pipelines using frameworks such as Apache Airflow or Luigi
- • Experience developing and deploying Python-based REST APIs (Flask or FastAPI) integrated with relational databases like PostgreSQL
- • Familiarity with core Python data science libraries including Pandas, NumPy, and scikit-learn for data manipulation and model evaluation
- • Practical experience training, deploying, and monitoring machine learning models in production environments
- • Strong commitment to writing clean, well-tested, maintainable code with emphasis on testing, documentation, and code reviews
🏖️ Benefits
- • Competitive salary package complemented by stock options that vest over four years, aligning your success with company growth
- • Comprehensive health insurance coverage for you and your family, plus access to daily chef-made breakfast and lunch, fresh fruit, snacks, and beverages on-site
- • Generous learning and development support with a £1,000 annual budget for courses, conferences, certifications, or technical books
- • Flexible working arrangements allowing 1–2 days per week remote work (up to 20 or 5 WFA days annually) and a cycle-to-work scheme to support sustainable commuting
- • Enhanced parental leave policies, pension scheme with up to 6% company-matched contributions via Aviva, and 25 days paid leave plus bank holidays with carryover option
- • Regular team-building activities including hackathons, social events, and collaborative forums that reinforce a culture of energy, curiosity, and mutual support
Skills & Technologies
Python
Go
Rust
React
Flask
Onsite
Degree Required
About Smarkets (Malta) Limited
Smarkets operates a peer-to-peer betting exchange that enables users to trade on sports, politics and current events at industry-low commission rates. The London-headquartered company combines exchange technology with risk-management systems to provide transparent pricing, deep liquidity and rapid settlement. Licensed in the UK and Malta, it also offers a mobile trading platform, API access and a same-game parlay product for retail and professional users.
Get more remote jobs like this
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
