[Remote] AI Project - QA Automation Engineer
Note: The job is a remote job and is open to candidates in USA. Timebox Pro is seeking a highly skilled QA Engineer with expertise in AI-driven systems to support their AI initiative. The role involves validating AI-powered customer interactions and ensuring high-quality, scalable, and reliable system behavior across multiple channels.
Responsibilities
- Execute standard QA testing cycles including Functional, Regression, and Synthetic testing
- Validate AI-driven customer interactions across chat, voice, and email channels
- Perform integration testing with backend systems (APIs, case management, data services)
- Test agent handoff and escalation workflows to ensure seamless transitions
- Ensure consistency of customer experience across multiple communication channels
- Conduct User Experience (UX) testing for clarity, usability, and interaction quality
- Perform Data Quality testing to validate accuracy and completeness of data used by AI systems
- Develop and maintain QA automation frameworks and test suites
- Design and implement AI-driven test suites to validate model accuracy, response quality, consistency, and overall system behavior
- Build and maintain API test automation
- Develop conversation simulation tests for AI interaction validation
- Maintain and enhance regression automation suites
- Integrate QA automation into CI/CD pipelines to enable continuous testing
Skills
- 3-5 years experience with expertise in AI-driven systems
- Strong experience in QA methodologies and automation frameworks
- Hands-on experience testing AI/LLM-based applications
- Experience with API testing and automation tools (e.g., pytest, Postman, REST frameworks)
- Understanding of multi-channel communication systems (chat, voice, email)
- Experience with CI/CD tools and pipeline integration
- Strong analytical and problem-solving skills
Company Overview
Company H1B Sponsorship