Qa engineer with GCP experience
JOB DESCRIPTION Key Skills: GCP Test Automation, CI/CD, API & UI testing automation, experience with Playwright framework and exposure to GenAI for test automation use case What you will do: API and Integration Testing:
- Design, develop, and execute comprehensive API test plans and test cases for AI models and services, covering functional, performance, security, and contract testing.
- Conduct rigorous testing of new language models (commercial and open source) via their APIs, focusing on accuracy, performance, scalability, and cost effectiveness.
- Validate data integrity and consistency across various API endpoints and integrations.
- Implement and maintain API test automation frameworks and tools.
Automation Development and Execution:
- Develop and maintain automated test scripts using Python and relevant testing frameworks to maximize test coverage and efficiency.
- Automate the testing of containerized microservices running in Google Cloud Platform (GCP) using appropriate CI/CD pipelines.
- Champion automation best practices and drive continuous improvement in automation coverage.
- Develop and maintain performance testing scripts for API endpoints and backend services.
AI Model Evaluation Framework Validation:
- Ensure the evaluation framework provides a robust and reliable environment for testing the latest AI offerings via automated processes.
- Develop automated tests to validate the functionality and performance of the evaluation framework itself.
- Implement automated reporting and analysis of test results.
- Run automated tests against one or multiple language models simultaneously through API interfaces.
Collaboration and Communication:
- Work closely with software engineers, data scientists, and other stakeholders to understand requirements and ensure the delivery of high quality AI solutions.
- Clearly communicate technical concepts and testing results to both technical and non technical stakeholders.
- Continuous Improvement:
- Stay abreast of the latest advancements in quality engineering, API testing, and AI technologies, incorporating best practices into the AI Hubs testing processes.
- Continuously evaluate and improve