Data Ingestion Specialist

📋 Description

• • Join Thyme Care Inc. as a Data Ingestion Specialist, a pivotal role within our Data Ingestion & Care Enablement (DICE) team. This position is instrumental in ensuring the seamless and reliable flow of partner and vendor data into our core systems, forming the bedrock of our advanced care enablement platform.
• • You will be a key collaborator, working closely with our Product Manager and fellow Data team members who specialize in data ingestion and analytics engineering. Your contributions will directly impact multiple ongoing deals and diverse data sources, providing critical support to Data Scientist deal owners.
• • Your primary focus will be on enhancing the consistency and reliability of data ingestion processes. This involves meticulously debugging failures, implementing robust testing strategies, establishing comprehensive monitoring solutions, and defining clear data contracts to elevate the overall dependability of our data infrastructure.
• • A significant aspect of your role will involve gaining an in-depth understanding of our data platform. You will actively contribute to the enhancement of our data models and pipelines, leveraging your expertise in SQL, dbt, and Python, particularly with data-focused libraries like pandas and polars.
• • You will be responsible for supporting the ingestion of a wide array of healthcare-related data sources, including but not limited to claims, eligibility, prior authorization, and Admission, Discharge, Transfer (ADT) data.
• • This support will manifest in several ways: configuring entirely new ingestion processes by parsing file specifications, validating initial assumptions, and proactively communicating any identified inconsistencies.
• • You will also be tasked with debugging issues that arise in existing, ongoing data ingestion streams, ensuring minimal disruption to operations.
• • Furthermore, you will play a crucial role in standardizing our ingestion processes and pipelines, promoting efficiency and maintainability across the team.
• • A core responsibility will be collaborating with data scientist deal owners and various internal stakeholders. Your objective will be to translate complex, often ambiguous, requirements into concrete mapping and validation logic, and to establish durable data contracts that govern data integrity and usage.
• • You will utilize Dagster and GitHub Actions to orchestrate and automate the initial stages of our data pipelines. This will involve improving run reliability, minimizing manual interventions, and ensuring efficient pipeline execution.
• • You will engage in hands-on data investigation using Jupyter Notebooks within the Databricks environment. This will involve troubleshooting data issues, validating critical assumptions, and resolving processing bottlenecks.
• • You will design and support incremental data loading strategies, implementing patterns such as append, merge, and upsert. Additionally, you will ensure the safety and integrity of reprocessing mechanisms, including idempotent runs, handling late-arriving data, and managing backfill operations.
• • You will learn to leverage Datadog and PagerDuty for proactive pipeline monitoring. This includes triaging incidents during business hours, clearly communicating the impact of any issues, and driving root-cause analysis to implement fixes that prevent recurrence.
• • You will contribute to a sophisticated, self-hosted dbt monorepo. Your contributions will include implementing transformations, developing incremental models, writing comprehensive tests, documenting processes, and establishing conventions that can scale effectively across numerous deals.
• • This role offers a unique opportunity to work at the intersection of healthcare, technology, and data, contributing to a mission-driven organization that is transforming cancer care. You will be part of a dynamic team focused on building a robust and reliable data foundation that empowers better patient outcomes.
• • By ensuring the quality and accessibility of critical healthcare data, you will directly contribute to Thyme Care's ability to provide connected, compassionate, and confident experiences for individuals navigating cancer treatment and beyond.
• • Your work will directly support the development and deployment of AI and automation technologies that simplify complexity and improve collaboration among care teams, ultimately allowing them to focus more on patient support.
• • This role is ideal for a detail-oriented individual with a passion for data quality and a desire to make a tangible impact in the healthcare technology sector. You will be empowered to take ownership of your work, drive improvements, and grow your expertise in a supportive and innovative environment.
• • You will be instrumental in building trust with our partners by ensuring their data is processed accurately and efficiently, which is fundamental to our value-based care enablement model.
• • The opportunity to work with cutting-edge tools and technologies in a fast-paced startup environment, while contributing to a meaningful cause, makes this a truly unique and rewarding position.