Prospera AI - QA Engineer (part time)

📋 Description

• • Prospera AI is at an exciting inflection point, building Sophie, a revolutionary multi-agent AI orchestrator designed to transform how wealth management advisors serve their clients. Our innovative platform delves into behavioral patterns, communication preferences, and emotional states to provide advisors with unprecedented insights, enabling them to deliver highly personalized and effective service. We are a well-funded, agile team with a proven technology and enthusiastic early adopters, now focused on scaling our engineering capabilities to meet growing demand.
• • As the first dedicated QA Engineer at Prospera AI, you will play a pivotal role in shaping and owning the quality assurance strategy for Sophie's advisor-facing product. This is a hands-on, high-ownership position where you will be instrumental in building our test automation framework from the ground up, establishing robust quality processes, and ensuring the flawless performance of every feature that advisors depend on, especially during critical live client interactions.
• • Your responsibilities will encompass defining our testing methodologies, identifying key areas for automation, and establishing clear criteria for what constitutes a "ready to ship" product. You will collaborate closely with our frontend and backend engineering teams, acting as a crucial gatekeeper to identify and resolve issues before they impact production. Your contributions will be vital in guiding Sophie from its current beta phase to a successful general availability launch.
• • **OWN TEST AUTOMATION:**
• • You will be responsible for building, maintaining, and expanding our end-to-end (E2E) test automation framework, leveraging Playwright as the primary tool. This includes developing comprehensive test suites that cover all critical advisor workflows, such as secure login procedures, client profile management, dynamic conversation flows, insightful data displays, and the generation of personalized recommendations.
• • Implement sophisticated visual regression testing strategies to proactively identify and rectify UI inconsistencies across a diverse range of browsers and devices, ensuring a consistent and polished user experience.
• • Establish and maintain component-level testing using React Testing Library and Vitest, enabling isolated testing of frontend components to ensure their individual functionality and integrity.
• • **ESTABLISH QUALITY INFRASTRUCTURE:**
• • Seamlessly integrate automated test suites into our Continuous Integration/Continuous Deployment (CI/CD) pipelines, utilizing GitHub Actions. This ensures that tests are executed automatically on every pull request, comprehensive regression tests run nightly, and essential smoke tests are performed post-deployment.
• • Set up and manage error tracking and monitoring solutions, such as Sentry, to proactively detect and address production issues, minimizing downtime and user impact.
• • Develop and maintain test coverage dashboards to provide the entire team with clear visibility into the extent of our testing efforts and identify areas requiring further attention.
• • Own and manage the release testing checklist, meticulously defining the criteria that must be met before any deployment can proceed to production, thereby ensuring a controlled and reliable release process.
• • **DEFINE QA PROCESS:**
• • Architect and implement a clear bug taxonomy and a streamlined triage process, including defined severity levels, service level agreements (SLAs), and standardized reproduction templates to ensure efficient bug management.
• • Oversee and manage bug tracking workflows utilizing tools like Linear and Notion, ensuring all issues are logged, prioritized, and tracked effectively.
• • Define and enforce a rigorous QA sign-off process, ensuring that no feature is released to production without explicit QA approval based on predefined acceptance criteria.
• • Implement a policy where every confirmed bug is accompanied by an automated regression test to prevent recurrence, thereby continuously improving product stability.
• • **ENSURE PRODUCTION READINESS:**
• • Conduct thorough end-to-end audits of the application, meticulously documenting all user flows, edge cases, and known issues to build a comprehensive understanding of the product's behavior.
• • Perform extensive cross-browser and cross-device testing to guarantee a consistent and reliable experience for advisors who utilize Sophie on various setups during client meetings.
• • Establish baseline performance metrics, including load times, streaming response rendering speed, and interaction responsiveness, to ensure optimal application performance.
• • Build and own the critical pre-launch quality gate, ensuring that all quality standards are met before any production release, safeguarding the integrity and reliability of Sophie.
• • This role is not a manual-only QA position; automation is the core focus. It is not a DevOps role, as your responsibilities will center on test pipeline configuration rather than infrastructure management. You will not be involved in AI/ML testing, as a separate team handles LLM evaluation and data pipeline QA. Furthermore, this is not a management role; the immediate focus is on individual contribution and establishing the foundational QA framework. We seek a proactive individual who drives quality standards, rather than someone who passively waits for tasks.