Software Engineer, ML Data Infrastructure

Ideogram Inc.

Job Overview

Location

Toronto

Job Type

Full-time

Full Job Description

📋 Description

• Build and scale distributed data infrastructure to support petabyte-scale generative AI training pipelines for multi-modal foundation models.
• Design and implement robust data processing workflows optimized for high-throughput, low-latency performance across TPU and GPU clusters.
• Collaborate directly with research scientists to translate complex data requirements into production-grade systems that accelerate model development cycles.
• Architect and maintain large-scale storage solutions using Google Bigtable, BigQuery, Spanner, and Pub/Sub to ensure data reliability and accessibility.
• Deploy and manage infrastructure on GCP using Kubernetes, Docker, and Terraform to enable scalable, repeatable ML workflows.
• Own end-to-end delivery of data infrastructure projects from initial scoping through deployment and iterative optimization.
• Troubleshoot and resolve systemic performance bottlenecks in data ingestion, transformation, and serving layers across distributed systems.
• Implement monitoring, logging, and alerting systems to ensure data pipeline health and minimize downtime in mission-critical training environments.
• Work cross-functionally with engineering and research teams to align data architecture with evolving model architectures and training objectives.
• Contribute to the design of data schemas, metadata systems, and versioning protocols that support reproducibility and traceability in generative media experiments.
• Optimize data storage costs and retrieval efficiency for massive datasets containing images, text, and other multi-modal inputs.
• Drive adoption of best practices in data engineering, including data quality validation, pipeline idempotency, and fault tolerance.
• Participate in code reviews, architecture discussions, and technical onboarding to foster a culture of high ownership and collective knowledge sharing.
• Maintain a strong bias for action in fast-moving, ambiguous environments, proactively identifying inefficiencies and proposing scalable solutions.
• Balance technical depth with product impact, ensuring infrastructure decisions directly enhance the quality and speed of AI-generated creative experiences.
• Contribute to documentation, runbooks, and internal tooling to improve team-wide operational efficiency and reduce onboarding friction.
• Engage in mentorship and knowledge transfer to support the growth of junior engineers and data infrastructure contributors.
• Operate with autonomy to experiment with new tools, frameworks, and architectures when aligned with clear business or creative use cases.
• Work from Ideogram’s Toronto HQ, with access to daily in-office lunches and dinners, and collaborate with a growing team in NYC.
• Leverage top-of-the-line hardware and cloud resources to run large-scale experiments and prototype next-generation data systems.

🎯 Requirements

• 2-5 years developing and shipping large-scale distributed systems with proven ability to manage complexity through thoughtful abstractions and scalable design
• Strong fundamentals in data structures, algorithms, and distributed systems
• Hands-on experience with large-scale data processing systems
• Strong understanding of databases and data storage architectures
• Demonstrated ability to drive projects from 0 to 1, including scoping, execution, and iteration
• Deep sense of ownership — proactively identifies opportunities, suggests improvements, and acts on them

🏖️ Benefits

• Competitive compensation and equity designed to recognize the value and impact of your contributions to Ideogram’s success
• 4 weeks of vacation to recharge and explore
• Comprehensive health, vision, and dental coverage starting on day one
• RRSP/401(k) with employer match up to 4% to invest in your future from the moment you join
• Top-of-the-line tools and tech to fuel your creativity and productivity
• Toronto HQ perks: Steps from Union Station and the PATH, with daily in-office lunches and dinners
• Autonomy to explore and experiment — access to compute/resources for clear business or creative use cases
• A culture of learning and growth, where curiosity is encouraged and mentorship is part of the journey

Skills & Technologies

Python

GCP

Docker

Kubernetes

Terraform

DevOps

Onsite

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Ideogram Inc.

Visit Website

About Ideogram Inc.

Ideogram Inc. operates a generative-AI platform that converts text prompts into photorealistic, graphic-design and artistic images. Founded in 2022 by former Google Brain researchers and headquartered in Toronto, the company trains proprietary diffusion models that excel in typography, logos and coherent text rendering. Through its web application and API, users create, remix and share visual assets for marketing, branding and creative projects. The service offers free tiers and paid subscriptions, emphasizing responsible AI practices, content safety filters and commercial licensing options.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.