Role overview

Staff Infrastructure Engineer — Observability

Requirements and responsibilities

Readable role content extracted into sections for faster review.

Primary responsibilities include:

  • Architect and implement robust, scalable telemetry platforms that empower SentinelOne engineers to deploy and monitor features with speed, safety, and reliability.
  • Act as the primary Subject Matter Expert (SME) and administrator for our core observability stack, including Grafana, Prometheus, Thanos/Mimir/Cortex, and OpenTelemetry (OTEL) pipelines.
  • Partner strategically with diverse engineering teams across the organization to define platform requirements, ensuring the observability ecosystem evolves ahead of stakeholder needs.
  • Take complete ownership of critical features, from initial architectural design and requirements refinement through to production deployment and operational maturity.
  • Drive exemplary operational efficiency for critical observability services across AWS and GCP, meticulously balancing unwavering system reliability with smart cloud cost-optimization.
  • Build robust automation and self-service tooling to drastically reduce operational toil, optimize resource utilization, and minimize pager fatigue.
  • Drive the deployment, maintenance, and compliance of observability systems in critical, high-security environments, including FedRAMP and air-gapped deployments.
  • Cultivate platform transparency and reliability by rigorously implementing IaC (Terraform/Ansible) and standardizing industry best practices.
  • Elevate engineering quality by mentoring team members, leading comprehensive technical design and code reviews, and providing constructive feedback that fosters growth.
  • Lead the swift resolution of highly complex production incidents, perform thorough root-cause analyses, and participate in on-call rotations to ensure peak system integrity.

Ideal candidates will have

  • 8+ years experience in Infrastructure Engineering, Site Reliability Engineering (SRE), or a related systems-focused field.
  • 8+ years experience in architecting, scaling, and managing enterprise-grade observability stacks utilizing Prometheus, Grafana, Thanos (or Mimir/Cortex), and OpenTelemetry (OTEL).
  • Experience design-engineering cloud-native infrastructure within major cloud providers (AWS or GCP) and managing production Kubernetes environments (EKS, GKE).
  • Advanced proficiency with IaC and automation tools, specifically Terraform and Ansible, to manage immutable infrastructure.
  • Experience maintaining and optimizing high-throughput, large-scale distributed systems with a focus on cost-efficiency, scalability, and disaster recovery.
  • Demonstrated ability to lead complex technical designs, mentor other engineers, and collaborate cross-functionally with product and application teams.
  • US Citizenship and the ability to work in a government-regulated environment.

Preferred Qualifications

  • 8+ years production-level programming experience in GoLang (highly desirable) or another mainstream language (e.g., Python, Java) with a strong willingness to adopt GoLang.
  • Experience working with high-security compliance frameworks, specifically FedRAMP or other sovereign cloud requirements.
  • Familiarity with the unique operational challenges of on-premises, hybrid, or air-gapped Kubernetes deployments.
  • Experience designing advanced CI/CD pipelines (e.g., GitHub Actions) and implementing sophisticated deployment strategies (canary, blue-green, rolling updates).

Equity & Rewards

  • Restricted Stock Units (RSUs)
  • Employee Stock Purchase Plan (ESPP)

Time Off & Wellbeing

  • Flexible time off
  • Paid company holidays and paid sick time
  • Gender-neutral parental leave
  • Grandparent leave

Insurance & Financial Security

  • Medical, dental, and vision coverage
  • 401(k) retirement plan with company match
  • Life and disability insurance
  • Health and dependent care FSA
  • Voluntary benefits (hospital, accident, critical illness)
  • Employee Assistance Program (EAP)
  • ARAG pre-paid legal
  • Nationwide pet insurance
  • Cancer Care program
  • Global business travel medical insurance

Work Perks & Flexibility

  • Home office allowance
  • Mobile phone reimbursement

Wellness & Lifestyle

  • Wellness coach
  • Wellness/gym reimbursement
  • Fertility coverage
  • Adoption & surrogacy reimbursement
Similar roles

Keep a backup shortlist.

Browse stack
FocusPlatform EngineeringRole area
Seniority signalSeniorCandidate level
StackAWS, CI/CD, GCPPrimary skills
Location1 accepted countryEligibility

Stack

Use these tags to compare similar remote roles.

Location eligibility

Candidates should apply only when their profile country is listed here.

Your profileCountry not setSign in to check your country against this role.

Hiring flow

WithMira shows the role, then sends candidates to the company application.

1Check role fit, stack, and location eligibility in WithMira.
2Open the company application page from the tracked apply link.
3Save the role or subscribe for similar opportunities before leaving.
Apply on company siteCompany siteOpen link