Senior Data Engineer

📋 Description

• • Fanvue is at the forefront of the creator economy, rapidly expanding as a premier AI-powered platform that empowers creators to connect, engage, and monetize their audiences at scale. Having recently secured Series A funding, we've achieved over $100M in annual recurring revenue, demonstrating triple-digit year-on-year growth and supporting hundreds of thousands of creators and millions of fans globally. As our growth accelerates, data has become an indispensable execution layer, critical for informing decisions across product development, business growth, financial strategy, and risk management. This pivotal role is designed to establish a robust, production-grade data foundation that the entire organization can rely on, thereby accelerating decision-making, enabling sophisticated analytics, and scaling machine learning capabilities.
• • As a Senior Data Engineer at Fanvue, you will be instrumental in owning and scaling our core data infrastructure. This is a foundational role with significant leverage, where you will be responsible for stabilizing data ingestion processes, enhancing system observability and governance, minimizing manual operational tasks, and facilitating advanced analytics and machine learning workloads. Your contributions will directly shape Fanvue's capacity to operate as a truly data-driven entity.
• • Key Responsibilities:
• • **Own and Stabilize Data Ingestion Pipelines:** Take full ownership of the end-to-end data ingestion lifecycle, ensuring reliability and efficiency. This includes managing Change Data Capture (CDC) ingestion using Amazon DMS, proactively resolving schema drift issues, and automating column ingestion processes to eliminate manual interventions and reduce operational overhead.
• • **Enhance Observability and Governance:** Build and implement production-grade observability for all data pipelines, dbt runs, and Athena performance. This involves establishing comprehensive monitoring and alerting systems to proactively detect and address data quality issues or pipeline failures before they impact downstream processes.
• • **Optimize CI/CD Workflows:** Streamline and optimize Continuous Integration and Continuous Deployment (CI/CD) workflows for data transformations. The goal is to significantly reduce pull request build times and deployment friction, enabling faster iteration cycles and more reliable releases.
• • **Develop Reusable Ingestion Frameworks:** Design and implement flexible, reusable ingestion frameworks that will accelerate the onboarding of new data sources, ensuring consistency and scalability across the platform.
• • **Establish Data Governance Practices:** Implement and enforce strong data governance practices. This includes integrating dbt tests into production environments and scheduling regular full-refresh pipelines to maintain data integrity and trustworthiness.
• • **Enable Advanced Analytics and ML:** Support the infrastructure required for advanced analytics and machine learning initiatives. This includes integrating with AWS SageMaker and establishing robust environments for ad-hoc analytics, empowering data scientists and analysts.
• • **Implement Access Controls:** Design and implement fine-grained Role-Based Access Controls (RBAC) to safeguard Personally Identifiable Information (PII) and other sensitive data as the company continues its rapid expansion.
• • **Manage Infrastructure as Code (IaC):** Own the Infrastructure as Code for the entire data platform using AWS CDK, ensuring that data infrastructure is versioned, thoroughly tested, and easily reproducible. This promotes consistency, reduces manual configuration errors, and facilitates disaster recovery.
• • **Cross-Functional Collaboration:** Work closely and collaboratively with the Platform, Analytics, and Product teams to ensure that the data infrastructure effectively aligns with and supports evolving business needs and strategic objectives.
• • This role offers a unique opportunity to build and scale critical data infrastructure from the ground up in a fast-paced, high-growth environment. You will have significant autonomy and the chance to make a tangible impact on the company's success by enabling data-driven decision-making across all departments.