Decision Intelligence Analyst

📋 Description

• • Rwazi Inc. is seeking a highly analytical and meticulous Decision Intelligence Analyst to join our dynamic Product team. This is a unique, fully remote opportunity for an individual passionate about ensuring the integrity and reliability of AI-driven decision-making processes. Our platform is designed to produce decision-grade outputs, leveraging structured reasoning and AI-assisted judgment. As the Decision Intelligence Analyst, you will be the ultimate owner of decision quality, acting as the critical quality control layer for our sophisticated decision intelligence engine. Your primary focus will be on rigorously evaluating system outputs, pinpointing weaknesses in reasoning, and enhancing AI judgment through systematic feedback and iterative training loops. This role is paramount in ensuring that Rwazi’s platform doesn't just generate outputs, but consistently delivers sound, defensible, and enterprise-grade decisions.
• • Your core mandate is to govern the reliability of our decision engine. This involves a deep dive into the logical integrity and soundness of reasoning within system outputs. You will be instrumental in identifying patterns of judgment failure or inconsistency, and then proactively designing structured feedback loops to systematically improve AI reasoning capabilities. A key part of your responsibility will be training and refining the AI judgment frameworks, ensuring they operate with precision and accuracy. Furthermore, you will define and implement measurable standards for decision quality, establishing benchmarks that ensure our outputs meet the highest levels of enterprise trust and credibility.
• • Key responsibilities will span across several critical areas. In Decision Output Evaluation, you will meticulously review system outputs for logical coherence and reasoning rigor, assessing the accuracy of signal interpretation and identifying any miscalculations in tradeoffs or flawed inference pathways. You will be responsible for documenting recurring reasoning gaps to inform future improvements. For AI Judgment Training, you will create structured examples specifically designed to refine reasoning performance, develop comprehensive edge-case libraries to enhance training robustness, and formalize evaluation rubrics that clearly define decision quality. A crucial aspect of this role involves close collaboration with our Research and Development (R&D) teams to propose and implement improvements to the reasoning architecture.
• • In the realm of Quality Standards & Metrics, you will define the measurable criteria that constitute decision-grade output, track the improvements in reasoning consistency over time, and monitor for any drift in output quality. Establishing clear acceptance thresholds for releasing new features or model updates will also be a key deliverable. Your expertise in Failure Mode Analysis will be vital in identifying systemic reasoning weaknesses, surfacing potential blind spots in signal modeling, and proposing structured adjustments to the logic layers. You will also be responsible for escalating any identified structural flaws early to the relevant teams. Finally, you will engage in extensive Cross-Functional Collaboration, partnering with the Product team to ensure quality aligns with roadmap goals, working closely with R&D on advanced reasoning improvements, and providing structured, actionable feedback to Engineering when system behavior deviates from expected logical pathways.
• • The impact of strong performance in this role is significant, leading to higher confidence in our decision outputs, a marked reduction in reasoning inconsistencies, and improved explainability of our AI’s judgments. You will contribute to the faster detection of system drift and foster stronger enterprise trust in Rwazi’s capabilities. Ultimately, this role is about protecting the intellectual credibility and market leadership of our platform. It is important to note that this role is not general QA, nor is it surface-level data validation or simple output review. Your focus is exclusively on the quality of reasoning, not formatting correctness or basic data integrity checks.
• • We are looking for individuals who possess strong analytical and logical reasoning abilities, coupled with experience in evaluating AI systems, decision frameworks, or complex models. Comfort in dissecting multi-step reasoning chains, the ability to formalize judgment criteria, and exceptional written clarity with structured thinking are essential. You should be comfortable working with ambiguity and identifying and addressing edge cases. Candidates from diverse backgrounds such as applied AI evaluation, consulting, operations research, economics, philosophy of logic, or other technically rigorous analytical fields are encouraged to apply. We value analysts who obsess over reasoning integrity, question outputs rather than accept them at face value, care deeply about intellectual rigor, and prefer structured evaluation over intuition. Comfort with holding high standards and a commitment to continuous improvement are key cultural fits. Your ability to critique and improve structured reasoning, the clarity of your evaluation frameworks, the depth of your logical analysis, your skill in identifying hidden failure modes, and your rigor in defining measurable quality standards will be paramount in our evaluation process. We prioritize demonstrated reasoning discipline over titles alone.