QA Engineer – GenAI & Automation

NStarX is an AI-first, Cloud-first engineering services company focused on AI, ML, Cloud, Automation, and Software Engineering. We help organizations accelerate business value through modern technology and engineering solutions.

ABOUT THE ROLE

We are looking for a QA Engineer – GenAI & Automation to test the complete technology stack of a Generative AI platform, including deployment, authentication, generation workflows, APIs, document exports, and UI. The role involves testing non-deterministic AI outputs, quality gates, and fail-closed behaviour.

KEY RESPONSIBILITIES

• Own the test strategy, test cases, and automation across the application stack.
• Maintain and enhance the existing automated test suite.
• Test AI generation workflows and verify fail-closed quality gates.
• Validate AI-generated outputs and ensure ungrounded or invalid content is appropriately withheld.
• Perform API, integration, UI, and end-to-end testing.
• Validate generated PPTX, DOCX, and PDF files against defined output contracts.
• Test SSO/SAML login, RBAC, authorization, and multi-user session behaviour.
• Validate UI error, loading, waiting, refusal, and edge-case states.
• Provide test evidence for quality gates, demos, and release reviews.

REQUIRED SKILLS & EXPERIENCE

• 5+ years of experience in Software QA / Test Automation.
• Strong experience with Python/pytest and/or JavaScript with Playwright/Cypress.
• Hands-on experience with API and integration testing.
• Experience testing authentication, authorization, RBAC, and negative scenarios.
• Strong understanding of end-to-end testing across distributed applications.
• Ability to take ownership of and extend an inherited automation framework.
• Strong defect analysis, troubleshooting, and documentation skills.

GOOD TO HAVE

• Experience testing Generative AI / LLM applications and non-deterministic outputs.
• Knowledge of golden-file and contract-based testing.
• Experience validating generated documents using python-pptx, python-docx, PDF parsing, or similar tools.
• Experience integrating automated tests into CI/CD pipelines.
• Knowledge of performance and load testing.

KEY COMPETENCIES

QA Automation | Python | Pytest | Playwright | Cypress | API Testing | Integration Testing | GenAI Testing | LLM Testing | UI Testing | SSO/SAML | RBAC | Document Validation | CI/CD | Performance Testing