Rust Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
About The Role
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Responsibilities
Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
What We're Looking For
Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
Obsessive about performance. You care about latency and throughput at a level most engineers don't.
Strong instinct for stability, with a track record of balancing ambitious change against reliability.
Major bonus: prior experience leading codebase migrations from another language to Rust.
Major bonus: a demonstrated history of shipping performance-critical systems.
Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
Why Join LiteLLM?
Own one of the most important technical bets in the company's roadmap.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits.
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to make LiteLLM the fastest AI gateway ever? Apply now!
","descriptionPlain":"Rust Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.\n\nAbout The Role\n\nYou'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.\n\nThis is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.\n\nResponsibilities\n\n - Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.\n\n - Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.\n\n - Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.\n\n - Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.\n\n - Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.\n\n - Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.\n\nWhat We're Looking For\n\n - Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.\n\n - Obsessive about performance. You care about latency and throughput at a level most engineers don't.\n\n - Strong instinct for stability, with a track record of balancing ambitious change against reliability.\n\n - Major bonus: prior experience leading codebase migrations from another language to Rust.\n\n - Major bonus: a demonstrated history of shipping performance-critical systems.\n\n - Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.\n\nWhy Join LiteLLM?\n\n - Own one of the most important technical bets in the company's roadmap.\n\n - Define the architectural foundation that the entire platform will run on.\n\n - Fast-paced growth environment with deep technical ownership.\n\n - Competitive salary, health, dental, and vision benefits.\n\nAbout LiteLLM\n\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to make LiteLLM the fastest AI gateway ever? Apply now!"},{"id":"759314e2-8415-4946-8701-88b1a7fad1b5","title":"Senior Backend Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-03-31T16:13:56.778+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/759314e2-8415-4946-8701-88b1a7fad1b5","applyUrl":"https://jobs.ashbyhq.com/litellm/759314e2-8415-4946-8701-88b1a7fad1b5/application","descriptionHtml":"Senior Backend Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.
About The Role
You’ll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.
Responsibilities
Build and scale our product, ensuring performance, reliability, and continuous improvement.
Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables
Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents
Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end users
Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems
Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics)
Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)
What We’re Looking For
Bachelor’s or Master’s in Computer Science or related field
1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)
Understanding of logging best practices, error handling, and secure backend development
Exposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)
Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)
Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilities
Eagerness to tackle hard bugs and ensure system transparency for end users
Why Join LiteLLM?
High-impact, mission-critical work on the core of compliance and reliability
Contribute directly to features used by enterprise customers at global scale
Fast-paced growth environment with room for technical ownership
Competitive salary, health, dental, and vision benefits
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to shape the future of secure, observable AI infrastructure? Apply now!
","descriptionPlain":"Senior Backend Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.\n\n\n\nAbout The Role\nYou’ll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.\n\n\n\nResponsibilities\n\n - Build and scale our product, ensuring performance, reliability, and continuous improvement.\n\n - Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables\n\n - Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents\n\n - Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end users\n\n - Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems\n\n - Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics)\n\n - Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)\n\n\n\nWhat We’re Looking For\n\n - Bachelor’s or Master’s in Computer Science or related field\n\n - 1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)\n\n - Understanding of logging best practices, error handling, and secure backend development\n\n - Exposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)\n\n - Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)\n\n - Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilities\n\n - Eagerness to tackle hard bugs and ensure system transparency for end users\n\n\n\nWhy Join LiteLLM?\n\n - High-impact, mission-critical work on the core of compliance and reliability\n\n - Contribute directly to features used by enterprise customers at global scale\n\n - Fast-paced growth environment with room for technical ownership\n\n - Competitive salary, health, dental, and vision benefits\n\n\n\nAbout LiteLLM\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\n\n\nReady to shape the future of secure, observable AI infrastructure? Apply now!"},{"id":"8d6724de-8d9f-4db3-bf6c-4e44da296bc3","title":"Account Executive","department":"Sales","team":"Sales","employmentType":"FullTime","location":"Remote","secondaryLocations":[],"publishedAt":"2026-06-22T22:08:21.936+00:00","isListed":true,"isRemote":true,"workplaceType":"Remote","address":{"postalAddress":{"addressCountry":"United States"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/8d6724de-8d9f-4db3-bf6c-4e44da296bc3","applyUrl":"https://jobs.ashbyhq.com/litellm/8d6724de-8d9f-4db3-bf6c-4e44da296bc3/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
We're looking for a Account Executive with experience in selling developer tools (e.g. gitlab, datadog, etc.) to large companies (>1k+ employees). You’ll own the sales cycle from qualified opportunity to close, working closely with the founders and early sales team. As the first sales hire, you will be working closely with the Founders (ex-Microsoft, ex-Coinbase) to help us transition from a founder-led sales motion to a scalable sales motion as we continue to grow at an exponential rate in 2025.
Own the Sales Process: Manage the entire sales cycle from qualified lead to close, including discovery, demo, proposal, and negotiation.
Drive Revenue: Work with the founders to help LiteLLM hit it’s revenue goals.
Customer Feedback Loop: Collaborate with product and engineering by sharing insights from customer conversations.
Build Repeatable Processes: Establish repeatable sales processes that will scale as the company grows.
Build the Sales Team: As we grow, you will also be responsible for building the future sales team by helping define KPIs, hiring criteria, and culture.
You love working with developers (30k+ Github stars)
You want to work hard (need to be always on - calls on weekends/post-dinner/etc.)
You want to learn how AI is transforming businesses (Businesses run ALL LLM calls through LiteLLM)
You enjoy building things from scratch (defining GTM, sales playbook, hiring)
2-4+ years of experience in full-cycle B2B sales, ideally in SaaS or tech startups. Experience selling to regulated industries (e.g. insurance, financial services) is a strong plus.
Proven track record of meeting or exceeding quota.
Excellent communication and storytelling skills, with the ability to tailor messaging to diverse buyer personas.
Self-starter who thrives in an early-stage environment and is excited to help build sales processes from the ground up
Strong organizational skills, with the ability to manage multiple opportunities through various stages of the sales pipeline.
Comfortable with CRM tools, sales automation platforms, and a fast-paced, feedback-driven culture.
Own one of the most important technical bets in the company's roadmap.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits.
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
This isn't a traditional product management role, and it isn't a traditional software engineering role.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.
Build new product features from concept to production.
Work directly with customers to understand pain points and validate solutions.
Ship quickly while maintaining a high quality bar.
Prototype new ideas and iterate based on user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Build intuitive developer experiences across our API, dashboard, and CLI.
Collaborate directly with the founders on product direction and technical decisions.
Help define and build LiteLLM's second major product.
Bachelor's or Master's degree in Computer Science or a related field.
Strong software engineering fundamentals.
Experience building production software, preferably with Python.
Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
Strong product intuition and curiosity about how customers use software.
Excellent written and verbal communication.
High ownership—you naturally identify problems and solve them without waiting to be asked.
Comfortable operating in ambiguity and making decisions with incomplete information.
Excited by shipping quickly and learning from real users.
Experience at an early-stage startup.
Experience building developer tools or infrastructure products.
Open source contributions.
You've built and launched your own product.
Familiarity with AI infrastructure, LLMs, or developer platforms.
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
","descriptionPlain":"PRODUCT ENGINEER\n\nLiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.\n\nWe're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.\n\n\n\nABOUT THE ROLE\n\nThis isn't a traditional product management role, and it isn't a traditional software engineering role.\n\nYou'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.\n\nIf you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.\n\n\n\nRESPONSIBILITIES\n\n - Build new product features from concept to production.\n\n - Work directly with customers to understand pain points and validate solutions.\n\n - Ship quickly while maintaining a high quality bar.\n\n - Prototype new ideas and iterate based on user feedback.\n\n - Own major product areas and continuously improve them over time.\n\n - Design backend APIs and services using Python and FastAPI.\n\n - Build intuitive developer experiences across our API, dashboard, and CLI.\n\n - Collaborate directly with the founders on product direction and technical decisions.\n\n - Help define and build LiteLLM's second major product.\n\n\n\nWHAT WE'RE LOOKING FOR\n\n - Bachelor's or Master's degree in Computer Science or a related field.\n\n - Strong software engineering fundamentals.\n\n - Experience building production software, preferably with Python.\n\n - Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).\n\n - Strong product intuition and curiosity about how customers use software.\n\n - Excellent written and verbal communication.\n\n - High ownership—you naturally identify problems and solve them without waiting to be asked.\n\n - Comfortable operating in ambiguity and making decisions with incomplete information.\n\n - Excited by shipping quickly and learning from real users.\n\n\n\nBONUS POINTS\n\n - Experience at an early-stage startup.\n\n - Experience building developer tools or infrastructure products.\n\n - Open source contributions.\n\n - You've built and launched your own product.\n\n - Familiarity with AI infrastructure, LLMs, or developer platforms.\n\n\n\nWHY JOIN LITELLM?\n\n - Work directly with the founders every day.\n\n - Build products used by thousands of engineering teams around the world.\n\n - Own meaningful product decisions—not just implementation.\n\n - Move incredibly fast and see your work in production immediately.\n\n - Help define the future of AI infrastructure and developer tooling.\n\n - Competitive salary, equity, health, dental, and vision benefits.\n\n\n\nABOUT LITELLM\n\nLiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.\n\nIf you love talking to users, building products, and shipping software that people actually use, we'd love to meet you."},{"id":"c04aeff0-8b7b-4fe9-aa0e-7cfca2480d22","title":"Solutions Architect","department":"Sales","team":"Sales","employmentType":"FullTime","location":"Remote","secondaryLocations":[],"publishedAt":"2026-04-20T22:28:55.239+00:00","isListed":true,"isRemote":true,"workplaceType":"Remote","address":{"postalAddress":{"addressCountry":"United States"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/c04aeff0-8b7b-4fe9-aa0e-7cfca2480d22","applyUrl":"https://jobs.ashbyhq.com/litellm/c04aeff0-8b7b-4fe9-aa0e-7cfca2480d22/application","descriptionHtml":"LiteLLM is the open-source AI gateway powering production AI traffic for NASA, Adobe, Netflix, Stripe, Nvidia, and many other Fortune 500s. We provide a unified API across 100+ LLM providers and act as the enterprise control plane for AI traffic. We're a YC W23 company with tens of thousands of GitHub stars and growing fast.
We're looking for a Solutions Architect to collaborate with our key customers, helping them successfully deploy and scale LiteLLM in production. You'll work directly with customers with primarily pre-sales, along with some post-sales, conducting demos, responding on complex architecture issues, and ensuring that our customers extract maximum value from the platform.
This role is ideal for someone who thrives in dynamic, customer-facing environments, enjoys solving customer challenges in real-time, and can translate customer needs into actionable product improvements.
Design, implement, and optimize solutions for our customers in pre-sales and post-sales capacities.
Collaborate with customers to identify business needs and tailor product integrations.
Partner closely with engineering and product teams to drive roadmap and deliver mission-critical features.
Serve as a technical and domain expert, bridging the gap between AI innovation and client requirements.
Build and document best practices and solution templates for rapid deployment.
3+ years of experience in sales engineering, solution engineering, technical consulting, or related roles in high-growth startups or tech companies.
Strong experience working with a developer audience, selling a technical product
Strong technical background; experience with Python and AI/ML products highly preferred.
Excellent communication, relationship-building, and problem-solving skills.
Proven ability to operate with autonomy in fast-paced, high-ownership environments.
You thrive working directly with customers at a fast-growing startup—scoping complex technical challenges, leading implementation discussions, and driving them to production success
You love working closely with developers (30K+ Github stars) and being at the intersection of product and customer
You want to work hard and move fast in a high-impact role
You want to see firsthand how AI is transforming businesses—our customers run ALL their LLM calls through LiteLLM
You enjoy the autonomy and variety of working across multiple customer environments and technical stacks
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens.
","descriptionPlain":"LiteLLM is the open-source AI gateway powering production AI traffic for NASA, Adobe, Netflix, Stripe, Nvidia, and many other Fortune 500s. We provide a unified API across 100+ LLM providers and act as the enterprise control plane for AI traffic. We're a YC W23 company with tens of thousands of GitHub stars and growing fast.\n\n\n\n\nABOUT THE ROLE\n\nWe're looking for a Solutions Architect to collaborate with our key customers, helping them successfully deploy and scale LiteLLM in production. You'll work directly with customers with primarily pre-sales, along with some post-sales, conducting demos, responding on complex architecture issues, and ensuring that our customers extract maximum value from the platform.\n\nThis role is ideal for someone who thrives in dynamic, customer-facing environments, enjoys solving customer challenges in real-time, and can translate customer needs into actionable product improvements.\n\n\n\n\nRESPONSIBILITIES\n\n - Design, implement, and optimize solutions for our customers in pre-sales and post-sales capacities.\n\n - Collaborate with customers to identify business needs and tailor product integrations.\n\n - Partner closely with engineering and product teams to drive roadmap and deliver mission-critical features.\n\n - Serve as a technical and domain expert, bridging the gap between AI innovation and client requirements.\n\n - Build and document best practices and solution templates for rapid deployment.\n\n\nREQUIREMENTS\n\n - 3+ years of experience in sales engineering, solution engineering, technical consulting, or related roles in high-growth startups or tech companies.\n\n - Strong experience working with a developer audience, selling a technical product\n\n - Strong technical background; experience with Python and AI/ML products highly preferred.\n\n - Excellent communication, relationship-building, and problem-solving skills.\n\n - Proven ability to operate with autonomy in fast-paced, high-ownership environments.\n\n\n\n\nWHY WORK AT LITELLM?\n\n - You thrive working directly with customers at a fast-growing startup—scoping complex technical challenges, leading implementation discussions, and driving them to production success\n\n - You love working closely with developers (30K+ Github stars) and being at the intersection of product and customer\n\n - You want to work hard and move fast in a high-impact role\n\n - You want to see firsthand how AI is transforming businesses—our customers run ALL their LLM calls through LiteLLM\n\n - You enjoy the autonomy and variety of working across multiple customer environments and technical stacks\n\n\nABOUT LITELLM\n\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens."},{"id":"ce69ca07-7a08-4a3a-95ca-b88949f83d05","title":"Head of Strategy and Operations","department":"Operations","team":"Operations","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-06-09T03:52:19.635+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/ce69ca07-7a08-4a3a-95ca-b88949f83d05","applyUrl":"https://jobs.ashbyhq.com/litellm/ce69ca07-7a08-4a3a-95ca-b88949f83d05/application","descriptionHtml":"LiteLLM is the open-source AI gateway powering production AI traffic for NASA, Adobe, Netflix, Stripe, Nvidia, and many other Fortune 500s. We provide a unified API across 100+ LLM providers and act as the enterprise control plane for AI traffic. We're a YC W23 company with tens of thousands of GitHub stars and growing fast.
As we scale, our enterprise customers expect support that matches the criticality of the workloads they run on us. We need someone to own that.
We are looking for a Head of Strategy and Operations to help define and accelerate our company internally. This role sits at the intersection of engineering, operations, and go-to-market. We are looking for a high-judgment, highly hands-on operator who is equally comfortable setting high-level strategy and rolling up your sleeves to get things done.
We have proven product-market fit, have grown beyond 10M ARR and are fully profitable.
We are seeking an experienced, data-driven and process-driven Head of Strategy of Operations to build our operational rigor and culture from the ground up and then iterate. You will build, implement and enforce the processes needed to smoothly scale an AI startup company. You will have immediate and direct impact.
Build our sales and customer success playbook and systems from the ground up and create a company culture around it
Focus on sales efficiency, pipeline health, pricing, and revenue forecasting
Define and enforce external SLAs across every channel (Slack Connect, email, Zendesk). Every customer thread has an owner, an ETA, and a clear next step at all times
Set up strategic KPIs and performance tracking for every department. Tell us with data whether we're under-resourced, whether someone is overloaded, or whether someone is underperforming
Continually iterate on our operational metrics and plan, owning challenges and consistently seeking improvements
Bridge the divide between high-level product roadmaps, engineering, and GTM execution
Recruit, mentor and manage our employees to set us up for long term growth and success as we scale
Be a listening ear for our team and our customers, taking actions to ensure internal team happiness and professional growth and external customer satisfaction with our product
Oversee our financial foundation and process from the ground up as we scale
Prior Leadership Experience in Operations or GTM - Prior experience in an operations or GTM capacity, specifically scaling a tech company in a leadership role from ~20 employees to at least 100 employees and beyond
Process Building and Documentation - Experience building a company’s sales and customer success processes and playbook from scratch or very early stages.
Recruiting, Sales and Success: You should have managed and excelled in all three of these functions, with an emphasis on metrics-based leadership and improvements.
Budgeting and Forecasting: We need to develop the mindset and processes for proper budgeting, forecasting and financial analysis. You will manage a finance professional but also should have the experience of implementing a financial foundation and process.
AI Product Experience: Strong experience working for an AI startup company. This role understands GTM strategy, product launch processes and timelines.
Enterprise Experience: Experience managing an enterprise SaaS business selling to Fortune 500 customers
Convenience. Must be San Francisco based.
Analytical Rigor. Strong background in data modeling, finance and analytics
Comfortable evaluating with data. You can look at your team's load and output and tell us, with metrics, what the team needs
Open-Minded - You respect the product vision of our founders but also have an operational vision for how to build our company, along with a successful track record.
Steady, Stable Enforcer. Works well under pressure. Needs to be able to enforce process adherence.
Strong Communicator and Mediator. Can handle multiple different personalities and work styles. World class oral and written communication skills
Strong Project Management and Delegation. Must be able to juggle multiple tasks at once.
$200,000 to $300,000 base salary plus bonus and equity and benefits. We pay at or above market for the right person, and the equity is meaningful at our stage and growth.
We also have 401(k) with a 3.5% match of employee contributions.
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About the Role
We're looking for a Senior Support Engineer to own our support queue and drive our customers to success. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them.
The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it.
Responsibilities
Own the support queue and work through tickets to drive customers to success
Diagnose customer issues and solve for the root cause, not just the symptom
Reproduce customer issues in their specific environments
Submit pull requests for bug fixes and improvements where needed
Act as the technical voice of the customer back to engineering
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Metrics-driven and hardworking, ready to move through a high volume of tickets
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits, 401k plan with 3.5% match.
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About The Role
You own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.
Responsibilities
Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to
Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync
Drive well-architected, consistent code patterns across the team
Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites
Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution
Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed
Look out for the open-source community and protect open-source adoption as the team scales
What We're Looking For
Been an EM before, with a track record of managing and shipping through a team
Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes
Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)
Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after
Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact
Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate
Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after
Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar
CS/engineering degree or equivalent hands-on engineering background
Worked at a startup, familiar with messy codebases and doing rewrites
Bonus: did this at an open-source company
Bonus: scaled the eng team at a fast-growing startup
Why Join LiteLLM?
High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway
Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting
Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down
A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater
High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it
Competitive salary, health, dental, and vision benefits
About LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to lead the team behind the most widely adopted AI gateway? Apply now!
","descriptionPlain":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.\n\nAbout The Role\nYou own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.\n\nResponsibilities\n\n - Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to\n\n - Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync\n\n - Drive well-architected, consistent code patterns across the team\n\n - Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites\n\n - Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution\n\n - Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed\n\n - Look out for the open-source community and protect open-source adoption as the team scales\n\nWhat We're Looking For\n\n - Been an EM before, with a track record of managing and shipping through a team\n\n - Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes\n\n - Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)\n\n - Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after\n\n - Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact\n\n - Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate\n\n - Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after\n\n - Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar\n\n - CS/engineering degree or equivalent hands-on engineering background\n\n - Worked at a startup, familiar with messy codebases and doing rewrites\n\n - Bonus: did this at an open-source company\n\n - Bonus: scaled the eng team at a fast-growing startup\n\nWhy Join LiteLLM?\n\n - High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway\n\n - Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting\n\n - Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down\n\n - A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater\n\n - High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it\n\n - Competitive salary, health, dental, and vision benefits\n\nAbout LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to lead the team behind the most widely adopted AI gateway? Apply now!"}],"apiVersion":"1"}