Job Overview
Location
US - San Francisco
Job Type
Full-time
Category
Data Engineer
Date Posted
May 16, 2026
Full Job Description
đź“‹ Description
- • Architect and lead the design of a governed, scalable Data Knowledge Platform that serves as the foundational infrastructure for AI agents, analytics, and real-time decision systems across Airwallex.
- • Design and implement three core layers: Data Layer (governed structured datasets including transactional records, event streams, and feature tables), Knowledge Layer (semantic definitions of business metrics, entity relationships, and contextual documentation), and Skills Layer (reusable analytical workflows, agent-callable tools, and automated transformation primitives).
- • Own the technical execution of regional and global data localization strategies within the Databricks environment, ensuring compliance with data residency requirements while maintaining a unified global data model.
- • Reconcile regional regulatory constraints (e.g., data sovereignty, privacy laws) with global consistency in metric definitions, data lineage, and knowledge artifacts across priority markets.
- • Design and implement “Agent Interfaces” — APIs and tooling that enable AI agents to interact reliably with the Knowledge and Skills layers for natural language querying and automated decision-making.
- • Define and enforce Governance-as-Code principles, embedding automated data lineage tracking, quality controls, and access governance directly into the data platform.
- • Lead global data modeling efforts to create unified schemas that accommodate regional variance without sacrificing consistency or performance.
- • Partner closely with Data Science, AI Engineering, Product, and Risk teams to ensure the platform enables high-quality experimentation, reproducible analytics, and trustworthy model outputs.
- • Drive adoption of the Data Knowledge Platform across engineering and non-engineering teams by making data and AI capabilities accessible, interpretable, and actionable for both humans and machines.
- • Establish and maintain industry-leading standards for data quality, metadata management, and semantic clarity to eliminate ambiguity in reporting and AI inference.
- • Mentor and guide senior engineers and architects on best practices in large-scale data system design, platform scalability, and AI-integrated data architectures.
- • Evaluate and integrate emerging technologies (e.g., RAG, MCP) to enhance the platform’s capabilities in serving real-time, context-aware data responses.
- • Ensure the platform evolves toward full AI agent-readiness by 2026, enabling customers and internal teams to extract actionable insights through natural language and automated workflows.
- • Maintain a deep understanding of regulatory landscapes in key markets (e.g., US, EU, APAC) to proactively align data architecture with evolving compliance mandates.
- • Champion a culture of first-principles thinking, operational rigor, and end-to-end ownership across the Data Knowledge Platform initiative.
🎯 Requirements
- • 10+ years of experience designing and building large-scale data systems with strong architectural fundamentals
- • Hands-on experience with the Databricks ecosystem, including Unity Catalog and Delta Lake
- • Experience implementing semantic layers or metric stores to enable consistent reporting and analytics
- • Solid understanding of how AI/agent-based systems consume data, with experience building APIs or data services to support them
- • Experience designing data solutions that meet regional data residency and compliance requirements
- • Demonstrated senior-level individual contributor experience, including leading design reviews and mentoring engineers
🏖️ Benefits
- • Competitive salary plus valuable equity within Airwallex
- • Collaborative open office space with a fully stocked kitchen
- • Regular team-building events
- • Freedom to be creative in a rapidly growing global fintech environment
Skills & Technologies
Kafka
Apache Spark
Senior
Onsite
Degree Required
About Airwallex (UK) Limited
Airwallex is a global financial technology company providing cross-border payment and banking infrastructure for businesses. It offers multi-currency accounts, foreign exchange, card issuing, expense management, and embedded finance APIs. Founded in Melbourne in 2015, the company serves enterprises and SMEs across Asia-Pacific, Europe, and the Americas, operating under licenses in multiple jurisdictions and processing billions in annualized transaction volume.
Get more remote jobs like this
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
