Back to search

Senior Software Engineer – Agentic AI & API Test Automation

Senior Software Engineer focused on agentic AI and API test automation, building and scaling AI-generated API end‑to‑end testing capabilities.

  • Remote, United States
  • Remote
  • Posted Nov 9, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Productize and enhance agentic AI workflow for automated API E2E test generation
  • Use AI workflows to analyze API behavior and generate executable Karate test scenarios
  • Develop reusable workflow components for API behavior inventory, test generation, validation, and maintenance
  • Implement human‑in‑the‑loop validation for AI‑generated tests
  • Support agentic workflows to reassess API coverage and generate/update relevant tests
  • Troubleshoot generation failures, invalid tests, retry conditions, and inconsistent AI‑generated output
  • Develop automated validation mechanisms for generated test structure, quality, and execution
  • Design, develop, execute, and maintain automated REST API and E2E tests using Karate
  • Translate API specifications into positive, negative, boundary, and failure scenarios
  • Validate API functionality, request/response structures, authentication, error handling, integrations, and service interactions
  • Measure automated test coverage against prioritized API behavior
  • Analyze and reduce flaky automated tests
  • Build repeatable local and CI/CD‑based execution capabilities
  • Create reusable test utilities, fixtures, test data mechanisms, assertions, and execution patterns
  • Integrate automated E2E tests into existing CI/CD pipelines
  • Support execution of tests locally before merge and automatically after deployment
  • Build and maintain containerized E2E test execution environments
  • Configure CI workflows to build and publish dedicated E2E test images
  • Integrate post‑deployment API verification into deployment pipelines
  • Configure appropriate test failures to act as promotion/release gates
  • Implement test failure reporting and auditable exception/override mechanisms
  • Troubleshoot CI/CD failures across code repositories, container builds, registries, deployment configurations, environment configuration, and test execution

Requirements

  • Bachelor's or Master's degree in Computer Science
  • Bachelor's or Master's degree in Software Engineering
  • Bachelor's or Master's degree in Information Technology
  • Bachelor's or Master's degree in Computer Engineering
  • Experience in a AI
  • Experience in a test automation

Skills

API test automationCI/CD integrationGit-based engineering workflowscontainerized test executionAI/agentic workflow developmentKarate test frameworkdeployment verificationtest quality measurementdeveloper onboardingKarateGitCI/CD pipelinescontainerization

Full description

Possible 3 Month CTH Role name: Senior Software Engineer – Agentic AI & API Test Automation Work Location: US (Remote) Start date: Immediate availability. Background check MANDATORY Role Overview We are seeking a hands-on Senior Software Engineer with strong experience in API test automation, software engineering, CI/CD integration, and AI/agentic workflow development to help productize and scale an AI-generated API End-to-End testing capability. The engineer will work on an existing pilot solution and help evolve it into a repeatable, production-ready capability that enables engineering teams to use agentic workflows to identify API behaviors, generate and maintain executable Karate API/E2E tests, validate generated tests, create reviewable code changes, and integrate those tests into established CI/CD pipelines. The role requires someone who can work across AI-assisted test generation, API automation, Git-based engineering workflows, containerized test execution, CI/CD pipelines, deployment verification, test quality measurement, and developer onboarding. This is primarily an engineering and automation role, rather than a manual QA/testing role. Key Responsibilities Agentic AI & Test Generation Productize and enhance an existing agentic AI workflow for automated API E2E test generation. Use AI/agentic workflows to analyze API behavior and generate executable, maintainable Karate test scenarios. Develop reusable workflow components for API behavior inventory, test generation, validation, and maintenance. Implement human-in-the-loop validation so AI-generated tests are reviewed and verified before being treated as production-ready. Support agentic workflows that can reassess API coverage when APIs are added or changed and generate/update relevant tests. Troubleshoot generation failures, invalid tests, retry conditions, and inconsistent AI-generated output. Develop automated validation mechanisms for generated test structure, quality, and execution. API & End-to-End Test Automation Design, develop, execute, and maintain automated REST API and E2E tests using Karate. Translate API specifications and expected service behavior into positive, negative, boundary, and failure scenarios. Validate API functionality, request/response structures, authentication, error handling, integrations, and service interactions. Measure automated test coverage against prioritized API behavior. Analyze and reduce flaky automated tests. Build repeatable local and CI/CD-based execution capabilities. Create reusable test utilities, fixtures, test data mechanisms, assertions, and execution patterns. CI/CD & DevOps Integration Integrate automated E2E tests into existing CI/CD pipelines. Support execution of tests locally before merge and automatically following deployment. Build and maintain containerized E2E test execution environments. Configure CI workflows to build and publish dedicated E2E test images. Integrate post-deployment API verification into deployment pipelines. Configure appropriate test failures to act as promotion/release gates. Implement test failure reporting and auditable exception/override mechanisms. Troubleshoot CI/CD failures across code repositories, container builds, registries, deployment configurations, environment configuration, and test execution. Containerization & Deployment Validation Ideally: 4+ years in API/integration/test automation. Strong recent CI/CD and Git experience. Hands-on containerization experience. Practical exposure to GenAI/agentic software engineering. Experience working directly with application/service development teams. 6–10 years of overall software engineering / test automation experience, with strong hands-on engineering capability. Education Bachelor's or Master's degree in one of the following: Computer Science Software Engineering Information Technology Computer Engineering

Senior Software Engineer – Agentic AI & API Test Automation at Talent Software Services, Inc. | Referso Jobs