Data Engineer

📋 Description

• • Daniels Health, Inc. is seeking a highly skilled and motivated Data Engineer to join our dynamic team in Chicago, IL. This is a critical role where you will be instrumental in designing, developing, and maintaining robust, scalable, and efficient data pipelines that form the backbone of our advanced data analytics and AI initiatives. As a mission-driven global innovator in healthcare waste management, Daniels Health is experiencing unprecedented growth across multiple continents. To support this expansion and our commitment to sustainable innovation, we are investing heavily in our data infrastructure and capabilities. You will be at the forefront of this transformation, ensuring that our data is clean, accessible, and ready to drive intelligent decision-making across our diverse global operations.
• • In this hands-on role, you will be responsible for the end-to-end development of ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes. This involves working with large, complex datasets from various sources, including operational systems, financial platforms, and IoT devices, to ingest, clean, and transform data into a usable format for analytics, reporting, and machine learning models. Your expertise in SQL will be paramount in querying, manipulating, and optimizing data within our data warehouse and data lake environments.
• • You will leverage Python as your primary scripting language for data manipulation, automation, and pipeline orchestration. Proficiency in Python libraries relevant to data engineering, such as Pandas, NumPy, and potentially frameworks like Apache Airflow or Prefect, will be essential for building efficient and maintainable data workflows. A significant part of your work will involve utilizing Databricks, a leading unified analytics platform, for data processing, transformation, and collaborative data science. This includes working with Spark for distributed computing, Delta Lake for reliable data storage, and Databricks SQL for efficient querying.
• • Collaboration is key to success in this role. You will work closely with Data Scientists, Data Analysts, Software Engineers, and business stakeholders to understand their data requirements and translate them into technical solutions. This cross-functional teamwork ensures that the data infrastructure we build directly supports business objectives and empowers teams to derive actionable insights.
• • You will be expected to contribute to the design and architecture of our data platform, ensuring scalability, reliability, and performance. This includes making informed decisions about data modeling, storage solutions, and processing frameworks. We are looking for someone who is not only technically proficient but also possesses a strong understanding of data governance, data quality, and data security best practices.
• • Operating within an Agile development environment, you will participate in sprint planning, daily stand-ups, and retrospectives, adapting to evolving project needs and delivering value iteratively. Your ability to manage your workload effectively, prioritize tasks, and communicate progress clearly will be vital.
• • We are passionate about engineering excellence and clean data. You will champion these principles, implementing robust testing strategies for data pipelines, writing clean and well-documented code, and continuously seeking opportunities to optimize existing processes and improve data quality. This commitment to quality ensures the integrity and trustworthiness of the data that drives our business.
• • The impact of your work will be far-reaching. By building and maintaining a high-performing data infrastructure, you will enable Daniels Health to gain deeper insights into operational efficiency, customer behavior, market trends, and the environmental impact of our services. This will directly support our strategic goals, including optimizing resource allocation, enhancing customer satisfaction, and driving sustainable growth across our global operations. You will be a key contributor to our data-driven culture, empowering every level of the organization with the information they need to succeed.
• • This role offers a unique opportunity to work with cutting-edge technologies in a rapidly growing, mission-focused company. You will have the chance to shape the future of data engineering at Daniels Health and make a tangible difference in the healthcare waste management industry.