Solutions Architect - Public Sector

Cohere Inc.

Job Overview

Location

Ottawa

Job Type

Full-time

Full Job Description

📋 Description

• As a Solutions Architect - Public Sector at Cohere Inc., you will play a pivotal role in advancing the company’s Defence and National Security business by designing and delivering cutting-edge agentic AI solutions that address complex mission-critical challenges. Your work will directly contribute to scaling intelligence for public sector clients, enabling them to harness frontier models for applications such as content generation, semantic search, retrieval-augmented generation (RAG), and autonomous agents—ultimately supporting national resilience and operational effectiveness.
• You will serve as the technical relationship owner for public sector customers, translating their strategic objectives into tailored AI architectures while acting as a trusted advisor and liaison between client stakeholders and Cohere’s product teams. This involves leading workshops, conducting deep technical dives, and crafting compelling narratives that demonstrate the business value of Cohere’s platform, ensuring alignment between technical execution and mission outcomes.
• Day to day, you will develop and deliver proof-of-concepts and pilot implementations using Cohere’s foundation models and the Agentic AI Foundry - North platform, focusing on scalable, secure, and customizable NLP and generative AI solutions. This includes designing agentic workflows, fine-tuning models for specific enterprise use cases, and orchestrating multiple interconnected agents to solve complex problems in defence and national security contexts.
• You will support the deployment and integration of large language models (LLMs) and custom AI solutions into production environments using Kubernetes, Docker, and cloud infrastructures (AWS, Azure, GCP), ensuring high performance, security compliance, and seamless integration with existing government IT systems. This involves troubleshooting, optimizing performance, and establishing best practices for MLOps and agent lifecycle management.
• Collaboration with Cohere’s product development team is central to your role; you will gather and synthesize customer feedback on agentic AI capabilities, identify gaps in current offerings, and advocate for product enhancements that reflect real-world public sector needs—directly influencing the roadmap for future features in model customization, safety, and orchestration.
• You will cultivate technical champions within customer organizations by providing training, best practice guidance, and ongoing support, thereby driving adoption, gathering iterative feedback, and building long-term partnerships that expand Cohere’s footprint in the public sector AI market.
• The Solutions Architect team at Cohere operates at the intersection of cutting-edge AI research and real-world enterprise deployment, working alongside world-class researchers, engineers, and product specialists who are passionate about pushing the boundaries of what foundation models can achieve. You will be part of a mission-driven culture that values intellectual rigor, customer obsession, and rapid iteration to deliver tangible impact.
• In this role, you will deepen your expertise in agentic AI systems, gain hands-on experience with state-of-the-art LLM deployment at scale, and develop rare proficiency in translating complex public sector requirements into secure, scalable AI architectures—positioning yourself as a leader in the emerging field of enterprise AI for government and defence applications.

🎯 Requirements

• 5+ years of experience in AI/ML solution architecture with demonstrated expertise in agentic AI, model customization, and deploying tailored AI models in enterprise environments.
• Strong hands-on skills with Python, Jupyter Notebooks, and cloud-native deployment frameworks including Kubernetes, Docker, and managed AI services such as AWS SageMaker, Bedrock, Azure AI Foundry, or Google Vertex AI.
• Experience designing and deploying "agentified" AI workflows involving multiple interconnected models or agents to solve business challenges, including hands-on work with agent orchestration frameworks like Cohere North.
• Familiarity with model fine-tuning methodologies and the development of AI agents optimized for specific workflows and enterprise needs, along with an in-depth understanding of generative LLM strengths, weaknesses, and operational considerations.
• Excellent communication skills to articulate complex AI architectures to both technical stakeholders and executive audiences, including the ability to lead workshops and facilitate technical deep dives.

🏖️ Benefits

• Open and inclusive culture with a strong emphasis on diversity, equity, and belonging, supported by accommodations for applicants during the recruitment process.
• Opportunity to work closely with a team at the forefront of AI research, including direct engagement with researchers and engineers building frontier models.
• Weekly lunch stipend, in-office lunches and snacks, plus full health and dental benefits with a separate budget for mental health care.
• 100% parental leave top-up for up to 6 months, personal enrichment benefits for arts, culture, fitness, well-being, and workspace improvement, and remote-flexible work options.
• Access to co-working stipends and offices in Toronto, New York, San Francisco, London, and Paris, along with 6 weeks of vacation (30 working days) annually.

Skills & Technologies

Python

AWS

Azure

Docker

Kubernetes

Senior

Remote

Ready to Apply?

Apply Externally

You will be redirected to an external site to apply.

Cohere Inc.

Visit Website

About Cohere Inc.

Cohere provides large language models and retrieval-augmented generation APIs for enterprise developers to embed conversational AI, search, summarization, and content generation into applications. Founded in 2021 by former Google Brain researchers, the company offers cloud and on-premise deployment, fine-tuning tools, and multilingual support to help organizations automate workflows, improve customer support, and analyze unstructured data while maintaining data privacy and security controls.

View Company Profile

Get more remote jobs like this

Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.

Weekly remote jobs and featured talent.

No spam. Only curated remote roles and product updates. You can unsubscribe anytime.