Software Engineer- Enterprise Platform

Details

• Multi-cloud capacity management
• Inference on B200 GPUs
• Multi-node inference
• Fractional H100 GPUs for efficient model serving
• Architect and develop infrastructure and platform features tailored for enterprise customers, including self-hosted clusters, single-tenant environments, and cross-cloud workload orchestration.
• Lead technical initiatives to productize secure and scalable private connectivity solutions.
• Design and implement solutions addressing the complex regulatory and compliance requirements of our customers, including data residency, auditability, and enterprise data protection.
• Advance our self-hosted infrastructure offerings, focusing on capacity management, release management, and observability tooling.
• Collaborate on partner-focused initiatives to deliver secure, minimal Baseten deployments within partner environments.
• Evaluate and implement emerging virtualization technologies to enhance platform isolation and security.
• Independently develop technical specifications, collaborate cross-functionally to define product requirements, and drive projects from conception through execution.
• Provide mentorship and leadership on enterprise infrastructure best practices, fostering knowledge-sharing across engineering teams.
• Bachelor's degree or higher in Computer Science or related field
• 5+ years of experience building distributed systems, cloud infrastructure, or Kubernetes-based solutions in production environments
• Past experience working with enterprise security, compliance, and privacy requirements
• Advanced understanding of distributed systems concepts, cloud architectures, and performance optimization
• Demonstrated ability to independently manage technical projects, from planning and specification through implementation
• Excellent collaboration and communication skills, with experience coordinating across functional teams and directly with customers
• Preferred experience working with AI/ML systems or familiarity with MLOps practices
• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.