Job Description

Roles & Responsibilities

• Automation Engineering

  • Build and maintain scalable UI and API automation frameworks using Playwright (TypeScript/JavaScript or Python).

  • Integrate automated tests into CI/CD pipelines.

  • Improve execution speed, reliability, and reduce flaky tests.

  Backend & Event-Driven Testing

  • Validate asynchronous workflows and distributed systems using Kafka or similar messaging platforms.

  • Implement contract testing and schema validation to ensure reliable communication between microservices.

  • Verify event publishing, consumption, and end-to-end data integrity.

  AI & LLM Validation

  • Test and evaluate GenAI/LLM-based features for accuracy, relevance, and hallucination handling.

  • Work with evaluation frameworks such as Ragas, LangSmith, or TruLens.

  • Build and maintain datasets for regression and prompt validation.

  Collaboration

  • Work closely with developers, AI engineers, and product teams to define quality strategies.

  • Participate in architecture, API, and prompt design discussions.

Desired Candidate Profile

• 5+ years of experience in QA Automation or Software Testing.

• Strong hands-on experience with Playwright.

• Experience testing APIs, microservices, and event-driven systems.

• Good understanding of Kafka, contract testing, and schema validation.

• Exposure to AI/LLM testing and RAG-based applications.

• Proficiency in TypeScript, JavaScript, or Python.

• Experience with CI/CD pipelines, Docker, and Kubernetes is a plus.