Product Engineer- Dedicated Inference

Details

• Chains for multi-component workflows
• Asynchronous inference
• Model APIs for frontier models
• Model training built for production inference
• Implement new features and products for the team
• Design ergonomic APIs and abstractions to solve customer problems
• Fix bugs and resolve customer issues with urgency
• Work across the stack - regardless of where you start, you’ll end up touching both React Components and Kubernetes Pods
• Work closely with the product and forward deployed engineering teams to develop and drive new product ideas
• Bachelor's degree or higher in Computer Science or related field
• Proficient coding abilities in one or more popular programming or scripting languages; Python, Go, or Javascript proficiency is a plus
• Familiarity with web applications & databases
• Good taste in product, particularly developer-oriented tools
• Interest in ML/AI infrastructure and willingness to learn
• Strong collaboration and communication skills
• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Fertility and family-building stipend through Carrot
• Company-facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.