SDET (ML/AI Chatbot)

We are seeking an SDET with Machine Learning / AI Chatbot testing expertise to drive innovation in AI-powered division leveraging Chatbots within their proprietary platform for external information. This is a great opportunity to work with cutting-edge AI and automation technologies.
Key Responsibilities
- Design, develop, and maintain automated test scripts and frameworks
- Deploy and configure reliable automation assets in CloudBees CI/CD pipelines
- Troubleshoot and resolve technical issues with automation infrastructure
- Create AI-based automation solutions using AWS Bedrock and frameworks like LangChain
- Integrate AI agents and solutions with existing automation platforms
- Implement self-healing test scripts and Intelligent Test Automation (ITA) strategies
- Apply context engineering to ensure AI-driven testing relevance and coverage
This position is a hybrid opportunity (1-2x onsite per week in Maryland and/or Wash DC office) and requires a final round F2F interview in Reston VA before offer.

Required Skills

Required Technical Skills
- Programming Languages: Python, JavaScript/TypeScript, Java, SQL, Unix Shell
- AI/ML Frameworks: AWS Bedrock, LangChain, prompt engineering (highly preferred)
- Test Automation: Selenium, Playwright, API testing frameworks
- Cloud & DevOps: AWS services, Docker, Kubernetes, Git
- CI/CD: CloudBees, Jenkins, pipeline automation
- Infrastructure: Test environment setup and maintenance
Key Qualifications
- Bachelor's degree in Computer Science, IT, or related field
- 5+ years of experience in software testing and test automation
- Proven experience with AI tools for test generation, refactoring, and self-healing
- Strong understanding of DevOps practices and CI/CD pipelines
- Experience building and scaling testing agents
- Knowledge of context engineering for AI-driven testing
Preferred Skills
- Experience testing or supporting AI/ML and Generative AI solutions, including LLMs, RAG architectures, prompt engineering, and AI model validation within enterprise applications.
- AWS certifications
- Experience with modern testing frameworks beyond Selenium
- Background in machine learning or AI applications
- Experience with microservices and containerized applications
- Knowledge of infrastructure as code (Terraform, CloudFormation)