Senior Data Engineer | Canada | Remote

📋 Description

• • Join Grafana Labs, a leading remote-first, open-source powerhouse, as a Senior Data Engineer and play a pivotal role in shaping our data infrastructure. With over 20 million users worldwide, Grafana is instrumental in monitoring diverse systems, from environmental sensors to critical business operations. Our company empowers over 3,000 organizations, including industry giants like Bloomberg, JPMorgan Chase, and eBay, to manage their observability strategies through the Grafana LGTM Stack, available as Grafana Cloud or the self-managed Grafana Enterprise Stack. This stack features scalable solutions for metrics (Grafana Mimir), logs (Grafana Loki), and traces (Grafana Tempo).
• • As we continue our rapid scaling, we remain committed to our core values: an open-source legacy, a collaborative global culture, and a passion for impactful work. You'll thrive in an innovation-driven environment where transparency, autonomy, and trust are paramount. This is a unique opportunity to contribute to a company that values meaningful work and fosters a culture of continuous improvement and learning.
• • This Senior Data Engineer role is a fully remote position, specifically seeking candidates within Canadian time zones. You will be instrumental in maintaining and evolving the frameworks and systems responsible for acquiring, validating, cleansing, and loading data into and out of our analytics platforms. The systems you build and manage will directly enable our business partners to achieve more accurate and reliable tracking and forecasting of sales, revenue, and usage/consumption metrics. Furthermore, you will spearhead the development of machine learning pipelines, crucial for productionizing our internal predictive models and driving data-informed decision-making across the organization.
• • Your engagement will span across multiple departments, including finance, revenue and CX operations, analytics teams, and analytics engineering. You will work with and enhance our existing technology stack, which includes Google Cloud Storage (GCS), BigQuery, dbt, dlt, Prefect, Python, Fivetran, Rudderstack, Hightouch, and OpenMetadata. Your contributions will be key to ensuring the integrity, efficiency, and scalability of our data operations.
• • Key responsibilities include building and maintaining production-quality data pipelines, facilitating both the ingress and egress of data between operational systems and BigQuery. You will be responsible for implementing robust data quality and freshness checks, along with comprehensive monitoring processes, to guarantee the accuracy and consistency of our data assets. This role also involves maintaining and actively contributing to our data ingestion framework, which leverages various purpose-built data load tool (dlt) connectors to streamline data acquisition.
• • Documentation is a critical aspect of this role; you will create and maintain thorough documentation for all data engineering processes, systems, and workflows, ensuring knowledge sharing and maintainability. You will also be responsible for the observability and monitoring of our internal data pipelines, proactively identifying and addressing potential issues. Troubleshooting and resolving data pipeline issues will be a core function, ensuring the continuous availability of downstream data critical for business operations.
• • You will contribute significantly to our dbt systems, ensuring that source and staging layers adhere to our established standards, are optimized for efficiency and cost-effectiveness, and maintain high availability. Additionally, you will participate in the investigation and implementation of event-driven data movement and transformation processes, exploring modern architectural patterns. You will also play a role in evaluating and implementing advanced analytic data storage and table formats, such as Apache Iceberg, to enhance our data warehousing capabilities and performance.
• • This position offers a chance to work on challenging problems in a dynamic, fast-paced environment. You will have the autonomy to drive solutions and collaborate with talented individuals across the globe. If you are a motivated self-starter with a passion for data and a desire to make a significant impact, this role is an exceptional opportunity to advance your career.