Job Overview
Location
Bengaluru, Karnataka
Job Type
Full-time
Category
Software Engineering
Date Posted
June 3, 2026
Full Job Description
đź“‹ Description
- • Lead the design, development, and execution of automated QA frameworks specifically for AI-driven systems and machine learning models used in customer loyalty platforms.
- • Collaborate with data scientists, machine learning engineers, and software developers to define test strategies that validate model accuracy, fairness, bias detection, and performance under real-world data conditions.
- • Build and maintain scalable test pipelines that integrate with CI/CD workflows to ensure continuous validation of AI outputs across multiple environments.
- • Develop test cases that evaluate edge cases, data drift, model degradation, and adversarial inputs to ensure robustness of AI-powered personalization engines.
- • Implement monitoring and alerting systems to detect anomalies in AI behavior post-deployment, including drift in recommendation accuracy or customer segmentation performance.
- • Work closely with product teams to translate business requirements for loyalty experiences into testable AI validation criteria, ensuring alignment between model outputs and customer engagement goals.
- • Document and standardize QA processes for AI systems, creating reusable templates for model evaluation, data validation, and result interpretation across projects.
- • Conduct root cause analysis on AI-related defects, identifying whether issues stem from data quality, model architecture, feature engineering, or inference pipeline failures.
- • Champion quality culture within the India Tech Hub by mentoring junior QA engineers and promoting best practices in AI testing, including explainability, reproducibility, and auditability.
- • Partner with global teams to align QA standards across Kobie’s international technology operations, ensuring consistency in AI validation methodologies.
- • Evaluate third-party AI tools and platforms for integration into Kobie’s loyalty ecosystem, assessing their testability, compliance, and scalability before adoption.
- • Stay current with emerging AI testing methodologies, tools, and industry standards to continuously improve the maturity of Kobie’s AI QA capabilities.
- • Participate in sprint planning, backlog refinement, and retrospectives to ensure QA priorities are integrated into agile development cycles.
- • Ensure all AI testing activities comply with data privacy regulations and internal governance policies governing customer data usage in loyalty programs.
- • Prepare and present QA metrics and risk assessments to technical and non-technical stakeholders to inform product decisions and release readiness.
🎯 Requirements
- • Proven experience in QA engineering for AI/ML systems, including testing of recommendation engines, NLP models, or predictive analytics platforms
- • Strong proficiency in Python and scripting languages for test automation and data validation
- • Experience with CI/CD tools (e.g., Jenkins, GitLab CI) and test frameworks (e.g., PyTest, unittest, MLflow)
- • Understanding of machine learning model evaluation metrics (e.g., precision, recall, F1, AUC, drift detection)
- • Familiarity with data validation tools and techniques for detecting bias, skew, or anomalies in training and inference datasets
- • Experience working in agile environments with cross-functional teams of data scientists and software engineers
🏖️ Benefits
- • Opportunity to be among the first hires in Kobie’s new India Tech Hub with significant influence on shaping its culture and processes
- • Work with global brands and cutting-edge AI systems powering personalized loyalty experiences for top-tier clients
- • Collaborate with a team of industry-leading experts in loyalty technology and data-driven customer engagement
- • Exposure to a proven Forrester Leader and USA Top Workplace with a 35-year legacy in innovation
Skills & Technologies
About Kobie Marketing, Inc.
Kobie is a Florida-based customer loyalty and retention marketing firm that designs, implements and manages end-to-end loyalty programs and technology platforms for Fortune 500 and mid-market brands across retail, financial services, travel and telecom industries. Services include program strategy, omnichannel creative, data analytics, rewards fulfillment, and Altegra, Kobie’s proprietary SaaS loyalty platform. Founded in 1990, the company operates from St. Petersburg headquarters and offices in New York and Toronto, serving clients such as Verizon, FedEx and Marriott. Kobie combines behavioral data science with personalized experiences to deepen customer relationships, increase lifetime value and drive measurable business growth.
Subscribe to the weekly newsletter for similar remote roles and curated hiring updates.
Newsletter
Weekly remote jobs and featured talent.
No spam. Only curated remote roles and product updates. You can unsubscribe anytime.
