Back to search

DevOps Engineer - Test and Performance

DevOps Engineer whose domain expertise sits squarely in testing — both performance and functional. This person builds and owns the platforms, pipelines, and automation that make testing repeatable, reliable, and embedded in every release.

  • Remote, India
  • Full-time
  • Remote
  • Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareDeveloper Tools & InfrastructureAI & Machine Learning

Responsibilities

  • Build and maintain CI/CD pipelines in Azure DevOps that integrate performance and functional testing as automated gates in every release.
  • Design and execute performance test strategies covering load, stress, endurance, spike, and scalability testing.
  • Design and execute functional test strategies including regression, integration, smoke, and end-to-end testing.
  • Build and maintain test scripts using Azure Load Testing, JMeter, Playwright, Selenium, or equivalent tools.
  • Design and manage synthetic data generation strategies that mirror production patterns without exposing real customer data — understanding data masking, referential integrity, and realistic volume simulation.
  • Create realistic workload models based on production traffic and usage patterns.
  • Gather non-functional requirements (response times, throughput, concurrency, SLAs) from business and technical stakeholders.
  • Run tests in pre-production environments and monitor application, infrastructure, and database metrics during execution.
  • Analyze results to identify bottlenecks in code, queries, infrastructure, configuration, or third-party integrations.
  • Use Application Insights and Azure Monitor to diagnose root causes and surface actionable findings.
  • Automate environment provisioning, test data seeding, test execution, and reporting to reduce manual effort and enable self-service testing for dev teams.
  • Create and manage ADO stories, test plans, and dashboards to track testing work alongside the broader engineering backlog.
  • Produce clear test reports with findings, risks, and recommendations for both technical and non-technical audiences.
  • Partner with developers and DevOps engineers to validate fixes, capacity improvements, and infrastructure changes.
  • Support capacity planning and production performance investigations as needed.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent hands-on experience.
  • Experience in a DevOps
  • Experience in a Test Engineering
  • Experience in a SDET

Nice to have: Terraform, Docker, Kubernetes, Postman, REST Assured, k6, Data masking, Tonic, Delphix, Faker libraries, Cloudflare, Datadog, New Relic, Grafana, SLOs, SLIs, error budgets

Skills

DevOpsPerformance TestingFunctional TestingAzure DevOpsJMeterAzure Load TestingPlaywrightSeleniumSynthetic Data GenerationAzure cloud servicesPythonJavaJavaScriptGroovySQLLinux/UnixAzure DevOpsJMeterPlaywrightSeleniumAzure Load TestingApplication InsightsAzure Monitor

Benefits

  • competitive benefits

Full description

About Convene Inc. Convene, Inc. is a Tampa based, award-winning technology services organization with offices and resources throughout the US, Mexico, and India. We have successful, referenceable customers, competitive benefits, and high-growth opportunities. DevOps Engineer — Performance and Functional Testing India Based Role - Experience: 3–6 years About the role We're looking for a DevOps Engineer whose domain expertise sits squarely in testing — both performance and functional. This person builds and owns the platforms, pipelines, and automation that make testing repeatable, reliable, and embedded in every release. You're not just running tests, you're engineering the systems that run them. You understand how to generate realistic synthetic data, simulate production workloads, and build quality gates that catch problems before they reach customers. You'll work across DevOps, development, and architecture to make sure nothing ships without being proven. Key responsibilities Build and maintain CI/CD pipelines in Azure DevOps that integrate performance and functional testing as automated gates in every release. Design and execute performance test strategies covering load, stress, endurance, spike, and scalability testing. Design and execute functional test strategies including regression, integration, smoke, and end-to-end testing. Build and maintain test scripts using Azure Load Testing, JMeter, Playwright, Selenium, or equivalent tools. Design and manage synthetic data generation strategies that mirror production patterns without exposing real customer data — understanding data masking, referential integrity, and realistic volume simulation. Create realistic workload models based on production traffic and usage patterns. Gather non-functional requirements (response times, throughput, concurrency, SLAs) from business and technical stakeholders. Run tests in pre-production environments and monitor application, infrastructure, and database metrics during execution. Analyze results to identify bottlenecks in code, queries, infrastructure, configuration, or third-party integrations. Use Application Insights and Azure Monitor to diagnose root causes and surface actionable findings. Automate environment provisioning, test data seeding, test execution, and reporting to reduce manual effort and enable self-service testing for dev teams. Create and manage ADO stories, test plans, and dashboards to track testing work alongside the broader engineering backlog. Produce clear test reports with findings, risks, and recommendations for both technical and non-technical audiences. Partner with developers and DevOps engineers to validate fixes, capacity improvements, and infrastructure changes. Support capacity planning and production performance investigations as needed. Required qualifications Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent hands-on experience. 3+ years of experience in a DevOps, test engineering, or SDET role with strong coverage across both performance and functional testing. Hands-on experience with JMeter or Azure Load Testing for performance, and Playwright, Selenium, or equivalent for functional testing. Strong understanding of synthetic data generation — building test datasets that are realistic, compliant, and representative of production patterns. Working knowledge of Azure cloud services (App Services, Application Insights, Azure Monitor, Log Analytics, VNets). Experience building and maintaining CI/CD pipelines in Azure DevOps, including YAML pipelines, release gates, and artifact management. Familiarity with Azure DevOps boards for story management, sprint planning, and backlog grooming. Scripting or programming skills in Python, Java, JavaScript, or Groovy. Comfort using AI-assisted coding tools like Claude or Copilot to accelerate development is a plus. Good understanding of web protocols (HTTP/HTTPS, REST, SOAP) and distributed application architecture. Working knowledge of SQL, stored procedures, and database performance fundamentals. Familiarity with Linux/Unix commands and system resource monitoring (CPU, memory, disk I/O, network). Strong analytical and problem-solving skills. Preferred qualifications Experience with Terraform or other IaC tools for test environment provisioning. Exposure to Docker, Kubernetes, or container-based testing environments. Experience with API testing tools like Postman, REST Assured, or k6. Familiarity with data masking and synthetic data tools (Tonic, Delphix, Faker libraries, or custom generators). Experience with Cloudflare or CDN performance testing. Familiarity with APM tools beyond Application Insights (Datadog, New Relic, Grafana). Understanding of SRE concepts like SLOs, SLIs, and error budgets. Experience with test management and reporting tools integrated into ADO. Soft skills Able to explain complex technical findings in plain language to engineers and leadership alike. Proactive and comfortable owning outcomes end to end, from test design through remediation follow-up. Builder mindset. If something can be automated, you automate it. If a platform doesn't exist, you build it. Collaborative and comfortable working across DevOps, development, and architecture in an Agile environment. Curious and always looking for better tools, better approaches, and better ways to catch problems earlier.

DevOps Engineer - Test and Performance at Convene Inc | Referso Jobs