Crowdstrike

QA Engineer- GTM Applications (Remote, IND)

Vaga remota de QA Engineering com fit claro de localização do candidato.

Publicada20 de jun. de 2026

Países elegíveis1 país aceito

Sinal de senioridadeMiddle

Modelo de trabalhoRemoto

Locais aceitos para candidatos

Índia

CI/CD LLM Python REST Salesforce Snowflake

Posso mesmo aplicar?Confira a lista de países

Países aceitos para candidatos estão listados (1).

Atualidade da fonte20 de jun. de 2026

Fit de localização1 país aceito

Match de stackCI/CD, LLM

Caminho de aplicaçãoSite da empresa

Resumo de fit da MiraPor que vale revisar esta vaga

Fit de localização1 país aceitoAdicione seu país

Match de stackAdicione skills ao perfil para compararCI/CD, LLM

Sinal de senioridadeMiddleDefina seu nível para uma análise mais precisa.

Prontidão para aplicarSite da empresaA aplicação continua no site da empresa.

Aplicação

Aplicar no site da empresa

Aplicação externa

Aplicando paraQA Engineer- GTM Applications (Remote, IND)Crowdstrike

Fit de país1 país aceito

Caminho de aplicaçãoSite da empresa

WithMiraSalve ou assine antes de sair

Aplicação da empresa

O WithMira mantém esta vaga para descoberta. A aplicação continua no site da empresa.

Aplicar no site da empresa

Salvar vaga

Resumo da vaga

QA Engineer- GTM Applications (Remote, IND)

Requisitos e responsabilidades

Conteúdo da vaga extraído em seções para revisão mais rápida.

What You’ll Do:

Define and own the end-to-end test strategy for agentic AI workstreams, establishing quality standards that account for the probabilistic, non-deterministic nature of LLM-powered systems.
Design and implement AI-specific evaluation frameworks covering hallucination detection, prompt quality scoring, agent task completion rates, and output faithfulness against ground-truth references.
Build and maintain automated test suites in Python using frameworks ( pytest, robot framework etc ) covering unit, integration, and system-level scenarios across all workstream components.
Develop RAG pipeline test coverage including retrieval precision and recall, semantic relevance scoring, context faithfulness, and end-to-end query-to-answer accuracy using tools such as RAGAS.
Design and Build QA automation tests leveraging industry-standard tools and technologies, encompassing functional, regression, and end-to-end integration testing across connected systems and platforms.
Build and execute Slack integration test suites validating bot response correctness, Workflow Builder trigger fidelity, agentic Slack bot state management, and error handling under edge-case inputs.
Integrate automated tests into CI/CD pipelines (GitHub Actions, Copado, Jenkins) so every pull request is gated by a defined quality bar before merge.
Design and execute performance and load tests for LLM-powered APIs, measuring latency percentiles, token throughput, and degradation patterns under concurrent load.
Conduct security and adversarial testing including prompt injection attempts, output validation for sensitive data leakage, and collaboration with the DevSecOps team on SAST/DAST pipeline findings.
Develop a regression strategy for non-deterministic outputs, defining acceptable variance thresholds, snapshot-based comparisons, and statistical scoring methods that flag genuine regressions without false positives.
Validate observability stack completeness — confirm that distributed tracing, structured logging, SLOs, and AI-specific metrics (latency, token throughput, hallucination rates) are instrumented correctly and alerting as expected.
Collaborate with engineers and the AI Product Owner from requirements grooming through sprint review, contributing testability requirements, acceptance criteria, and definition-of-done checklists.
Own API contract testing across internal and third-party integrations (Salesforce, Marketo, Snowflake, Gong, Clari, G-Suite) using tools such as Postman or REST-assured.
Drive defect lifecycle ownership: triage, severity classification, root cause analysis, regression prevention, and post-release quality retrospectives that feed back into the test strategy.
Champion a shift-left quality culture, coaching engineers to write testable code, instrument their own unit tests, and treat quality as a shared team responsibility rather than a gate at the end of the sprint.

What You’ll Need:

Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
6+ years of QA or SDET experience, with a track record of building and maintaining automated test frameworks in production environments.
Hands-on experience testing AI or ML systems, with a solid understanding of why non-deterministic outputs require different evaluation strategies than conventional software.
Strong proficiency in Python for test automation, including designing reusable test utilities, fixtures, mocks, and data factories.
Experience with test frameworks and tooling such as pytest, Selenium, Playwright, REST-assured, Postman, or equivalent.
Practical understanding of LLM behaviour including temperature effects, token limits, prompt sensitivity, and failure modes that impact test reproducibility.
Hands-on Salesforce QA testing experience encompassing validation of Lightning Web Component (LWC) behaviors, Platform Event flows, and API integrations.
API testing proficiency across REST endpoints, including contract validation, schema conformance, payload verification, and error-path coverage.
Experience integrating automated tests into CI/CD pipelines so quality gates are enforced automatically on every code change.
Familiarity with RAG evaluation metrics — faithfulness, answer relevance, context recall — and tooling such as RAGAS or LangSmith for structured AI output evaluation.
Experience with performance and load testing tools (Locust, k6, JMeter, or similar) to validate LLM-powered API behaviour under realistic and peak load.
Working knowledge of security testing basics: prompt injection, output sanitisation, OWASP top-10 awareness, and coordination with DevSecOps tooling.

Bonus Points:

ISTQB Advanced Test Analyst certification or equivalent recognised QA certification.
Salesforce certifications such as Platform App Builder, Platform Developer I, or Salesforce Administrator that support deeper integration test design.
Experience with AI evaluation frameworks and observability platforms such as RAGAS, LangSmith, Datadog LLM Observability, or OpenTelemetry for AI workloads.
Hands-on experience testing Slack applications, including event-driven webhook testing, slash command validation, and agentic Slack bot conversation-flow coverage.
Contributions to open-source test tooling, evaluation libraries, or QA frameworks relevant to AI systems or enterprise integrations.
Exposure to chaos engineering or adversarial ML testing methodologies, including fault-injection, boundary testing, and red-teaming LLM-powered agents.
Familiarity with observability and APM tooling (Datadog, Grafana, OpenTelemetry) and the ability to validate that instrumentation is correctly implemented.
Prior experience in a cybersecurity, fintech, or high-compliance software environment where quality standards carry regulatory or contractual weight.

Benefits of Working at CrowdStrike:

Market leader in compensation and equity awards
Comprehensive physical and mental wellness programs
Competitive vacation and holidays for recharge
Paid parental and adoption leaves
Professional development opportunities for all employees regardless of level or role
Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections
Vibrant office culture with world class amenities
Great Place to Work Certified™ across the globe

Vagas similares