AI Data Engineer - Cortex AI

📋 Description

• • Join TechTorch, a dynamic and rapidly growing enterprise technology consultancy, as an AI Data Engineer and play a pivotal role in shaping the future of AI-powered solutions for leading private equity-backed businesses. We are on a mission to redefine enterprise technology consulting by combining the agility of a scale-up with the rigorous discipline demanded by sophisticated investors and operators. Our data and AI teams are at the forefront of designing and building modern data platforms that fuel advanced analytics, intelligent AI agents, and transformative GenAI-enabled business workflows. We leverage cutting-edge technologies like Snowflake, AWS, and various enterprise systems to create scalable data products, deliver AI-driven insights, and implement automation strategies for our clients.
• • In this critical role, you will be instrumental in designing, building, and maintaining robust data pipelines and AI-ready data platforms, with Snowflake serving as the core data warehouse. You will harness the power of Snowflake Cortex AI, AWS Bedrock, and other mainstream AI services to enable sophisticated analytics, unlock LLM-powered use cases, and drive AI-driven automation across diverse enterprise environments. This position uniquely sits at the confluence of data engineering excellence and practical AI application, ensuring that data is not only high-quality and well-modeled but also readily accessible and optimized for downstream analytics, machine learning models, and cutting-edge GenAI applications.
• • Your responsibilities will encompass the full lifecycle of data pipeline development and AI integration. You will architect and implement scalable data pipelines, ensuring seamless data flow and transformation within the Snowflake ecosystem. A key focus will be on developing sophisticated AI-ready data models and feature layers, meticulously crafted to support a wide array of analytics, machine learning, and GenAI initiatives. You will be empowered to leverage Snowflake Cortex AI's advanced capabilities for tasks such as generating embeddings, performing text classification, summarizing complex information, and enabling AI-assisted analytics directly within the data warehouse. Furthermore, you will integrate and operationalize complex AI workflows by utilizing AWS Bedrock and its associated AWS services, including Lambda for serverless compute and Step Functions for workflow orchestration, ensuring robust and scalable AI solutions.
• • Building and optimizing ELT (Extract, Load, Transform) pipelines will be a core part of your daily work, employing industry-standard tools like dbt, SQL, and Python to ensure efficient data processing and transformation. You will be adept at integrating data from a wide spectrum of sources, including RESTful APIs, various SaaS platforms, relational and NoSQL databases, and real-time event streams, creating a unified and comprehensive data landscape. A paramount aspect of your role will be upholding the highest standards of data quality, implementing robust observability practices, and ensuring strict data governance across all data pipelines and AI workloads. This commitment to data integrity is fundamental to the success of our AI initiatives.
• • Collaboration will be key to your success. You will work closely with talented AI engineers, data scientists, and business stakeholders to deeply understand their needs and translate complex use cases into practical, scalable, and production-grade data solutions. Clear and comprehensive documentation of data models, pipeline architectures, and AI-related design decisions will be essential for ensuring long-term maintainability and knowledge sharing within the team and across client engagements. You will contribute to a culture of innovation and technical excellence, pushing the boundaries of what's possible with data and AI in the enterprise space.
• • This role offers an unparalleled opportunity to work on state-of-the-art AI-first data platforms, directly contributing to the digital transformation of prominent private equity-backed companies. You will gain invaluable exposure to high-impact projects at the intersection of data engineering and applied AI, operating within a global, collaborative team that upholds stringent technical standards. Embrace a flexible, remote-first working environment that fosters autonomy, ownership, and continuous professional growth.