LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
Skills: Python, LLM APIs, FastAPI
As the Backend LLM Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
What is our tech stack
The tech stack includes Python, FastAPI, Redis, Postgres.
1-2 years of backend/full-stack experience with production systems
Passion for open source and user engagement
Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
Strong work ethic and ability to thrive in small teams
Eagerness to talk to users and help solve real problems
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
","descriptionPlain":"LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.\n\n\n\n\n\nWHAT YOU WILL BE WORKING ON\n\nSkills: Python, LLM APIs, FastAPI\n\nAs the Backend LLM Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:\n\n - System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)\n\n - Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK\n\n - Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases\n\nWhat is our tech stack\n\nThe tech stack includes Python, FastAPI, Redis, Postgres.\n\n\n\n\n\nWHO WE ARE LOOKING FOR\n\n - 1-2 years of backend/full-stack experience with production systems\n\n - Passion for open source and user engagement\n\n - Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)\n\n - Strong work ethic and ability to thrive in small teams\n\n - Eagerness to talk to users and help solve real problems\n\n\n\n\n\nWHY JOIN LITELLM?\n\n - Work directly with the founders every day.\n\n - Build products used by thousands of engineering teams around the world.\n\n - Own meaningful product decisions—not just implementation.\n\n - Move incredibly fast and see your work in production immediately.\n\n - Help define the future of AI infrastructure and developer tooling.\n\n - Competitive salary, equity, health, dental, and vision benefits.\n\n\n\nABOUT LITELLM\n\nLiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.\n\nIf you love talking to users, building products, and shipping software that people actually use, we'd love to meet you."},{"id":"93705fde-0daa-49ce-94be-4551d3ac662d","title":"Senior Security Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"Remote","secondaryLocations":[],"publishedAt":"2026-07-25T21:49:08.043+00:00","isListed":true,"isRemote":true,"workplaceType":"Remote","address":{"postalAddress":{"addressCountry":"United States"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/93705fde-0daa-49ce-94be-4551d3ac662d","applyUrl":"https://jobs.ashbyhq.com/litellm/93705fde-0daa-49ce-94be-4551d3ac662d/application","descriptionHtml":"LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. Our platform gives developers secure, reliable access to LLMs and adjacent services. We’re looking for our first Security Engineer to help secure LiteLLM’s application, infrastructure, and software-delivery pipeline.
This is a hands-on security generalist role with a strong emphasis on application security. You’ll spend most of your time reviewing and hardening LiteLLM’s Python codebase, identifying new attack surfaces, working directly with engineers to fix vulnerabilities, and making secure development practices part of how we build.
You’ll also own security work across IT, CI/CD, cloud infrastructure, and the software supply chain. The ideal candidate has built application/product/infrastructure security programs from scratch and genuinely enjoys security outside of work—through CTFs, vulnerability research, open-source projects, or independent experimentation.
Conduct deep security reviews of LiteLLM’s Python proxy, APIs, authentication systems, and enterprise features.
Identify and remediate vulnerabilities involving authentication, authorization, secrets, tenant isolation, injection, and data exposure.
Partner directly with engineers throughout design, implementation, code review, and release—not only after code is shipped.
Build application-security tooling into the development lifecycle, including SAST, DAST, dependency scanning, and secrets detection.
Perform internal red teaming and adversarial testing against LiteLLM’s APIs, proxy, and LLM-specific attack surfaces.
Threat-model new products and architecture changes before they reach production.
Create secure coding guidelines and train engineers on common vulnerabilities and defensive practices.
Harden LiteLLM’s Docker images, PyPI packages, GitHub Actions workflows, and release infrastructure.
Detect dependency confusion, poisoned packages, compromised dependencies, exposed secrets, and unsafe build practices.
Implement SBOMs, signed builds, provenance checks, and reproducible-build practices.
Design secure-by-default configurations for cloud and self-hosted deployments, including authentication, IAM, secrets management, and key rotation.
Review cloud infrastructure, network boundaries, access controls, and production deployment patterns.
Strengthen employee identity, device, SaaS, and internal access controls.
Build monitoring and anomaly detection for suspicious API, model, authentication, and routing activity.
Lead security incident response, vulnerability assessment, remediation, post-mortems, and stakeholder communication.
Establish formal vulnerability intake, CVE triage, disclosure, and remediation processes.
Maintain threat models as LiteLLM’s product and architecture evolve.
A strong security generalist who can work across application security, IT, CI/CD, cloud infrastructure, and the software supply chain.
Deep application-security expertise, including manually auditing production Python code and working with engineers to remediate vulnerabilities.
Strong understanding of authentication, authorization, tenant isolation, SSRF, injection, deserialization, secrets management, and common web and API vulnerabilities.
Experience using and configuring tools such as Semgrep, Bandit, CodeQL, Burp Suite, and other SAST or DAST tooling.
Previous experience at an early-stage security startup during its 0→1 journey.
Experience securing containers, GitHub Actions, build pipelines, packages, and software dependencies.
Familiarity with SBOMs, Sigstore, Cosign, Snyk, Grype, Trivy, or equivalent tooling.
Strong knowledge of OAuth2, JWT, mTLS, IAM, and high-throughput API authentication.
Familiarity with prompt injection, LLM data exfiltration, tool abuse, and the OWASP Top 10 for LLM Applications.
Experience with incident response, CVSS scoring, vulnerability management, CVE triage, and coordinated disclosure.
Experience competing in CTFs during college or independently pursuing vulnerability research, reverse engineering, bug bounties, or security projects.
A genuine interest in security outside your day job—you regularly explore new attack techniques, build security projects, or contribute to the security community.
Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
Work on application-security problems at the intersection of AI, APIs, and developer infrastructure.
Secure an open-source product used by enterprises around the world.
Work directly with engineers and influence how security is incorporated into product development.
Take broad technical ownership in a fast-moving environment.
Competitive salary and health, dental, and vision benefits.
LiteLLM is a Python SDK and Proxy Server that enables seamless access to more than 100 LLM APIs through the OpenAI format.
Ready to secure the infrastructure powering enterprise AI? Apply now.
","descriptionPlain":"SENIOR SECURITY ENGINEER\n\nLiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. Our platform gives developers secure, reliable access to LLMs and adjacent services. We’re looking for our first Security Engineer to help secure LiteLLM’s application, infrastructure, and software-delivery pipeline.\n\n\nABOUT THE ROLE\n\nThis is a hands-on security generalist role with a strong emphasis on application security. You’ll spend most of your time reviewing and hardening LiteLLM’s Python codebase, identifying new attack surfaces, working directly with engineers to fix vulnerabilities, and making secure development practices part of how we build.\n\nYou’ll also own security work across IT, CI/CD, cloud infrastructure, and the software supply chain. The ideal candidate has built application/product/infrastructure security programs from scratch and genuinely enjoys security outside of work—through CTFs, vulnerability research, open-source projects, or independent experimentation.\n\n\nRESPONSIBILITIES\n\n\nAPPLICATION SECURITY\n\n - Conduct deep security reviews of LiteLLM’s Python proxy, APIs, authentication systems, and enterprise features.\n\n - Identify and remediate vulnerabilities involving authentication, authorization, secrets, tenant isolation, injection, and data exposure.\n\n - Partner directly with engineers throughout design, implementation, code review, and release—not only after code is shipped.\n\n - Build application-security tooling into the development lifecycle, including SAST, DAST, dependency scanning, and secrets detection.\n\n - Perform internal red teaming and adversarial testing against LiteLLM’s APIs, proxy, and LLM-specific attack surfaces.\n\n - Threat-model new products and architecture changes before they reach production.\n\n - Create secure coding guidelines and train engineers on common vulnerabilities and defensive practices.\n\n\nINFRASTRUCTURE, CI/CD, AND SUPPLY-CHAIN SECURITY\n\n - Harden LiteLLM’s Docker images, PyPI packages, GitHub Actions workflows, and release infrastructure.\n\n - Detect dependency confusion, poisoned packages, compromised dependencies, exposed secrets, and unsafe build practices.\n\n - Implement SBOMs, signed builds, provenance checks, and reproducible-build practices.\n\n - Design secure-by-default configurations for cloud and self-hosted deployments, including authentication, IAM, secrets management, and key rotation.\n\n - Review cloud infrastructure, network boundaries, access controls, and production deployment patterns.\n\n\nIT SECURITY AND INCIDENT RESPONSE\n\n - Strengthen employee identity, device, SaaS, and internal access controls.\n\n - Build monitoring and anomaly detection for suspicious API, model, authentication, and routing activity.\n\n - Lead security incident response, vulnerability assessment, remediation, post-mortems, and stakeholder communication.\n\n - Establish formal vulnerability intake, CVE triage, disclosure, and remediation processes.\n\n - Maintain threat models as LiteLLM’s product and architecture evolve.\n\n\nWHAT WE’RE LOOKING FOR\n\n - A strong security generalist who can work across application security, IT, CI/CD, cloud infrastructure, and the software supply chain.\n\n - Deep application-security expertise, including manually auditing production Python code and working with engineers to remediate vulnerabilities.\n\n - Strong understanding of authentication, authorization, tenant isolation, SSRF, injection, deserialization, secrets management, and common web and API vulnerabilities.\n\n - Experience using and configuring tools such as Semgrep, Bandit, CodeQL, Burp Suite, and other SAST or DAST tooling.\n\n - Previous experience at an early-stage security startup during its 0→1 journey.\n\n - Experience securing containers, GitHub Actions, build pipelines, packages, and software dependencies.\n\n - Familiarity with SBOMs, Sigstore, Cosign, Snyk, Grype, Trivy, or equivalent tooling.\n\n - Strong knowledge of OAuth2, JWT, mTLS, IAM, and high-throughput API authentication.\n\n - Familiarity with prompt injection, LLM data exfiltration, tool abuse, and the OWASP Top 10 for LLM Applications.\n\n - Experience with incident response, CVSS scoring, vulnerability management, CVE triage, and coordinated disclosure.\n\n - Experience competing in CTFs during college or independently pursuing vulnerability research, reverse engineering, bug bounties, or security projects.\n\n - A genuine interest in security outside your day job—you regularly explore new attack techniques, build security projects, or contribute to the security community.\n\n - Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.\n\n\nWHY JOIN LITELLM?\n\n - Work on application-security problems at the intersection of AI, APIs, and developer infrastructure.\n\n - Secure an open-source product used by enterprises around the world.\n\n - Work directly with engineers and influence how security is incorporated into product development.\n\n - Take broad technical ownership in a fast-moving environment.\n\n - Competitive salary and health, dental, and vision benefits.\n\n\nABOUT LITELLM\n\nLiteLLM https://github.com/BerriAI/litellm is a Python SDK and Proxy Server that enables seamless access to more than 100 LLM APIs through the OpenAI format.\n\nReady to secure the infrastructure powering enterprise AI? Apply now."},{"id":"759314e2-8415-4946-8701-88b1a7fad1b5","title":"Senior Backend Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-03-31T16:13:56.778+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/759314e2-8415-4946-8701-88b1a7fad1b5","applyUrl":"https://jobs.ashbyhq.com/litellm/759314e2-8415-4946-8701-88b1a7fad1b5/application","descriptionHtml":"Senior Backend Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.
About The Role
You’ll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.
Responsibilities
Build and scale our product, ensuring performance, reliability, and continuous improvement.
Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables
Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents
Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end users
Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems
Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics)
Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)
What We’re Looking For
Bachelor’s or Master’s in Computer Science or related field
1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)
Understanding of logging best practices, error handling, and secure backend development
Exposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)
Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)
Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilities
Eagerness to tackle hard bugs and ensure system transparency for end users
Why Join LiteLLM?
High-impact, mission-critical work on the core of compliance and reliability
Contribute directly to features used by enterprise customers at global scale
Fast-paced growth environment with room for technical ownership
Competitive salary, health, dental, and vision benefits
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to shape the future of secure, observable AI infrastructure? Apply now!
","descriptionPlain":"Senior Backend Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.\n\n\n\nAbout The Role\nYou’ll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.\n\n\n\nResponsibilities\n\n - Build and scale our product, ensuring performance, reliability, and continuous improvement.\n\n - Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables\n\n - Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents\n\n - Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end users\n\n - Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems\n\n - Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics) \n\n - Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)\n\n\n\nWhat We’re Looking For\n\n - Bachelor’s or Master’s in Computer Science or related field\n\n - 1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)\n\n - Understanding of logging best practices, error handling, and secure backend development\n\n - Exposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)\n\n - Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)\n\n - Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilities\n\n - Eagerness to tackle hard bugs and ensure system transparency for end users\n\n\n\nWhy Join LiteLLM?\n\n - High-impact, mission-critical work on the core of compliance and reliability\n\n - Contribute directly to features used by enterprise customers at global scale\n\n - Fast-paced growth environment with room for technical ownership\n\n - Competitive salary, health, dental, and vision benefits\n\n\n\nAbout LiteLLM\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\n\n\nReady to shape the future of secure, observable AI infrastructure? Apply now!"},{"id":"791652d5-1b40-4a54-bc22-a75c16131ddc","title":"Founding Developer Relations","department":"Product","team":"Product","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-30T23:58:30.424+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/791652d5-1b40-4a54-bc22-a75c16131ddc","applyUrl":"https://jobs.ashbyhq.com/litellm/791652d5-1b40-4a54-bc22-a75c16131ddc/application","descriptionHtml":"LiteLLM is the open-source AI gateway used by developers and enterprises to access, manage, and govern LLMs through a unified interface.
Teams use LiteLLM to route requests across model providers, control spend, monitor usage, implement security policies, and reliably operate AI applications in production.
We are looking for our first Developer Relations hire to help more developers discover LiteLLM, understand what they can build with it, and successfully deploy it in production.
LiteLLM has a large and growing technical community. Developers discover the project through GitHub, documentation, search, technical content, and recommendations from other engineers.
But discovering LiteLLM is only the beginning.
Developers need to quickly understand how LiteLLM fits into their stack, see credible examples of it solving real problems, and get from their first request to a production deployment. They also need clear ways to share feedback, contribute to the project, and learn about new capabilities.
You will help us build that developer journey.
This is LiteLLM’s first dedicated Developer Relations role. You will establish how we educate developers, engage with the community, support product launches, and turn developer feedback into better documentation, examples, and product decisions.
This is a hands-on technical individual-contributor role.
You will spend much of your time building with LiteLLM and turning what you learn into resources that help other developers succeed. You should be equally comfortable opening a code editor, explaining an infrastructure concept, and talking with developers about where they are getting stuck.
In a typical month, you will:
Build and maintain runnable demos, sample applications, integrations, and reference architectures for real LiteLLM use cases.
Create technical guides, videos, workshops, launch demos, and deep dives that make complex capabilities understandable and immediately usable.
Engage directly with developers through GitHub, community channels, livestreams, meetups, conferences, and other technical forums.
Partner with Product and Engineering on launches so new capabilities ship with strong examples, documentation, and a clear technical story.
Identify recurring questions and points of friction, then turn them into better documentation, examples, product feedback, issues, or code contributions where appropriate.
Explore the wider AI developer ecosystem and build useful examples with the models, frameworks, tools, and platforms LiteLLM users care about.
Use developer feedback and adoption data to decide which educational resources, integrations, and community initiatives will have the greatest impact.
Represent LiteLLM publicly through technical talks, workshops, videos, podcasts, and conversations with the developer community.
This is not a traditional social-media or event-marketing role, and it is not a frontline support position.
You will help individual developers, but the goal is to turn what you learn into resources and improvements that help the entire community. You will not be measured by content volume or impressions alone. The best outcome might be a runnable example that unlocks an important use case, an explanation that becomes the canonical resource for a difficult topic, or a pattern of feedback that leads us to improve the product.
Because this is a founding role, you will also help define our Developer Relations priorities, operating cadence, and measures of success. You will shape the function while continuing to ship technical work yourself.
Create high-quality tutorials, demos, sample applications, reference architectures, videos, and technical deep dives.
Develop educational resources around the problems developers are actively trying to solve.
Explain LiteLLM capabilities such as model routing, fallbacks, cost controls, observability, authentication, guardrails, MCP, and production deployment.
Keep examples and technical content accurate as LiteLLM and the wider AI ecosystem evolve.
Improve the path from reading about a capability to successfully implementing it.
Build genuine relationships with developers using, evaluating, and contributing to LiteLLM.
Participate in GitHub discussions, community channels, technical forums, and open-source conversations.
Help developers get unstuck while identifying patterns that should become durable resources or product improvements.
Support contributors and power users and create opportunities for them to share what they have built.
Represent LiteLLM at relevant conferences, meetups, workshops, livestreams, podcasts, and community events.
Build a structured feedback loop between the developer community and LiteLLM’s Product and Engineering teams.
Identify recurring points of confusion, missing integrations, documentation gaps, and product friction.
Reproduce technical issues and distinguish between documentation, usability, and product problems.
Turn developer feedback into clear product recommendations, issues, examples, and documentation improvements.
Contribute technical fixes directly when they are within scope, while partnering with Engineering on larger product changes.
Own the developer-facing execution for major product and open-source launches.
Work with Product and Engineering to understand what is shipping, who it is for, and why it matters.
Produce the demos, sample code, tutorials, documentation, and technical explanations developers need to try new capabilities.
Ensure launches show working implementations rather than only announcing features.
Evaluate whether launches result in meaningful developer understanding and adoption.
Establish LiteLLM’s initial Developer Relations priorities and operating rhythm.
Determine where technical content, integrations, community engagement, and events can have the greatest impact.
Define practical measures of success based on developer adoption, successful implementations, community participation, and product learning.
Build repeatable systems for turning product releases and developer questions into useful technical resources.
Help define how the Developer Relations function should evolve as LiteLLM grows.
During your first 90 days, you will:
Become a hands-on LiteLLM user and develop a deep understanding of the product, codebase, documentation, and community.
Build several production-quality example applications covering LiteLLM’s most important use cases.
Audit the developer journey from initial discovery through successful production deployment.
Identify the highest-impact gaps in our documentation, examples, onboarding, and technical storytelling.
Meet developers, contributors, customers, and internal teams to understand how LiteLLM is being used and where people struggle.
Establish a repeatable process for supporting developer-facing product launches.
Ship an initial set of tutorials, demos, or integrations based on the needs you uncover.
Create a system for turning recurring community questions into documentation, examples, or product feedback.
Propose a focused Developer Relations roadmap for the following six months.
You have experience in Developer Relations, Developer Advocacy, software engineering, solutions engineering, or another highly technical developer-facing role.
You can write working software and are comfortable building examples in Python.
You can read an unfamiliar codebase, debug integrations, reproduce issues, and communicate clearly with engineers.
You are an exceptional technical communicator who can make complex infrastructure concepts understandable without oversimplifying them.
You enjoy talking with developers and are genuinely curious about how they build and operate software.
You have strong product instincts and notice where APIs, workflows, examples, or documentation create unnecessary friction.
You can create across multiple formats, including sample applications, written tutorials, technical talks, workshops, and video.
You are comfortable being a visible external representative of a technical product and open-source project.
You operate with high ownership and do not need an existing playbook to begin shipping useful work.
You care about whether your work changes developer behavior, improves implementations, and produces meaningful product learning.
You can move quickly without compromising technical accuracy.
Experience with developer infrastructure, APIs, observability, security, cloud platforms, or open-source software.
Familiarity with LLM application architecture and the challenges of operating AI systems in production.
Experience with AI model providers, gateways, agent frameworks, MCP, Kubernetes, or enterprise AI platforms.
Meaningful contributions to an open-source project.
Experience building a technical audience through writing, videos, workshops, talks, or community participation.
Experience establishing Developer Relations at an early-stage company.
Experience working with platform engineers, infrastructure teams, or enterprise developers.
An existing body of technical work you can show us, such as applications, tutorials, talks, videos, documentation, or open-source contributions.
Within six months:
Developers can understand LiteLLM’s major capabilities and reach a successful implementation faster.
LiteLLM has a growing collection of credible, production-oriented examples and reference architectures.
Major launches consistently include strong technical education, sample code, demos, and documentation.
Recurring community questions are systematically converted into durable resources or product improvements.
Product and Engineering have a clearer, evidence-based understanding of what developers need.
More developers are building publicly with LiteLLM, contributing to the project, and helping other community members.
LiteLLM has a focused Developer Relations strategy with clear priorities and practical measures of impact.
The Developer Relations function operates as a repeatable system rather than a collection of one-off activities.
Work on open-source infrastructure at the center of the rapidly evolving AI developer ecosystem.
Help developers solve real production problems involving reliability, security, cost, observability, and governance.
Work directly with the founders and engineering team.
Establish LiteLLM’s Developer Relations function from the beginning.
Shape both how developers understand LiteLLM and how the product evolves.
Move quickly and see your work used by developers around the world.
Receive competitive compensation, equity, health, dental, and vision benefits, and a 401(k) plan with company match.
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Head of Engineering to lead the team building the leading OSS AI gateway.
About The Role
You own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.
Responsibilities
Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to
Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync
Drive well-architected, consistent code patterns across the team
Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites
Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution
Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed
Look out for the open-source community and protect open-source adoption as the team scales
What We're Looking For
Been an EM before, with a track record of managing and shipping through a team
Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes
Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)
Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after
Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact
Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate
Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after
Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar
CS/engineering degree or equivalent hands-on engineering background
Worked at a startup, familiar with messy codebases and doing rewrites
Bonus: did this at an open-source company
Bonus: scaled the eng team at a fast-growing startup
Why Join LiteLLM?
High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway
Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting
Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down
A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater
High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it
Competitive salary, health, dental, and vision benefits
About LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to lead the team behind the most widely adopted AI gateway? Apply now!
","descriptionPlain":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Head of Engineering to lead the team building the leading OSS AI gateway.\n\nAbout The Role\nYou own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.\n\nResponsibilities\n\n - Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to\n\n - Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync\n\n - Drive well-architected, consistent code patterns across the team\n\n - Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites\n\n - Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution\n\n - Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed\n\n - Look out for the open-source community and protect open-source adoption as the team scales\n\nWhat We're Looking For\n\n - Been an EM before, with a track record of managing and shipping through a team\n\n - Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes\n\n - Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)\n\n - Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after\n\n - Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact\n\n - Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate\n\n - Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after\n\n - Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar\n\n - CS/engineering degree or equivalent hands-on engineering background\n\n - Worked at a startup, familiar with messy codebases and doing rewrites\n\n - Bonus: did this at an open-source company\n\n - Bonus: scaled the eng team at a fast-growing startup\n\nWhy Join LiteLLM?\n\n - High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway\n\n - Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting\n\n - Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down\n\n - A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater\n\n - High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it\n\n - Competitive salary, health, dental, and vision benefits\n\nAbout LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to lead the team behind the most widely adopted AI gateway? Apply now!"},{"id":"3f326076-7415-46a1-921e-8a1b1d6ee2b6","title":"Rust Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-06-16T17:18:01.841+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/3f326076-7415-46a1-921e-8a1b1d6ee2b6","applyUrl":"https://jobs.ashbyhq.com/litellm/3f326076-7415-46a1-921e-8a1b1d6ee2b6/application","descriptionHtml":"Rust Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
About The Role
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Responsibilities
Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
What We're Looking For
Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
Obsessive about performance. You care about latency and throughput at a level most engineers don't.
Strong instinct for stability, with a track record of balancing ambitious change against reliability.
Major bonus: prior experience leading codebase migrations from another language to Rust.
Major bonus: a demonstrated history of shipping performance-critical systems.
Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
Why Join LiteLLM?
Own one of the most important technical bets in the company's roadmap.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits.
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to make LiteLLM the fastest AI gateway ever? Apply now!
","descriptionPlain":"Rust Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.\n\nAbout The Role\n\nYou'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.\n\nThis is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.\n\nResponsibilities\n\n - Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.\n\n - Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.\n\n - Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.\n\n - Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.\n\n - Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.\n\n - Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.\n\nWhat We're Looking For\n\n - Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.\n\n - Obsessive about performance. You care about latency and throughput at a level most engineers don't.\n\n - Strong instinct for stability, with a track record of balancing ambitious change against reliability.\n\n - Major bonus: prior experience leading codebase migrations from another language to Rust.\n\n - Major bonus: a demonstrated history of shipping performance-critical systems.\n\n - Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.\n\nWhy Join LiteLLM?\n\n - Own one of the most important technical bets in the company's roadmap.\n\n - Define the architectural foundation that the entire platform will run on.\n\n - Fast-paced growth environment with deep technical ownership.\n\n - Competitive salary, health, dental, and vision benefits.\n\nAbout LiteLLM\n\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to make LiteLLM the fastest AI gateway ever? Apply now!"},{"id":"e103c38c-60e3-4b8c-b391-cf7c20a20080","title":"Senior Support Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-07T20:17:55.735+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/e103c38c-60e3-4b8c-b391-cf7c20a20080","applyUrl":"https://jobs.ashbyhq.com/litellm/e103c38c-60e3-4b8c-b391-cf7c20a20080/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About the Role
We're looking for a Senior Support Engineer to own our support queue and drive our customers to success. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them.
The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it.
Responsibilities
Own the support queue and work through tickets to drive customers to success
Diagnose customer issues and solve for the root cause, not just the symptom
Reproduce customer issues in their specific environments
Submit pull requests for bug fixes and improvements where needed
Act as the technical voice of the customer back to engineering
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Metrics-driven and hardworking, ready to move through a high volume of tickets
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits, 401k plan with 3.5% match.
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
This isn't a traditional product management role, and it isn't a traditional software engineering role.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.
Build new product features from concept to production.
Work directly with customers to understand pain points and validate solutions.
Ship quickly while maintaining a high quality bar.
Prototype new ideas and iterate based on user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Build intuitive developer experiences across our API, dashboard, and CLI.
Collaborate directly with the founders on product direction and technical decisions.
Help define and build LiteLLM's second major product.
Bachelor's or Master's degree in Computer Science or a related field.
Strong software engineering fundamentals.
Experience building production software, preferably with Python.
Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
Strong product intuition and curiosity about how customers use software.
Excellent written and verbal communication.
High ownership—you naturally identify problems and solve them without waiting to be asked.
Comfortable operating in ambiguity and making decisions with incomplete information.
Excited by shipping quickly and learning from real users.
Experience at an early-stage startup.
Experience building developer tools or infrastructure products.
Open source contributions.
You've built and launched your own product.
Familiarity with AI infrastructure, LLMs, or developer platforms.
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
","descriptionPlain":"PRODUCT ENGINEER\n\nLiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.\n\nWe're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.\n\n\n\nABOUT THE ROLE\n\nThis isn't a traditional product management role, and it isn't a traditional software engineering role.\n\nYou'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.\n\nIf you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.\n\n\n\nRESPONSIBILITIES\n\n - Build new product features from concept to production.\n\n - Work directly with customers to understand pain points and validate solutions.\n\n - Ship quickly while maintaining a high quality bar.\n\n - Prototype new ideas and iterate based on user feedback.\n\n - Own major product areas and continuously improve them over time.\n\n - Design backend APIs and services using Python and FastAPI.\n\n - Build intuitive developer experiences across our API, dashboard, and CLI.\n\n - Collaborate directly with the founders on product direction and technical decisions.\n\n - Help define and build LiteLLM's second major product.\n\n\n\nWHAT WE'RE LOOKING FOR\n\n - Bachelor's or Master's degree in Computer Science or a related field.\n\n - Strong software engineering fundamentals.\n\n - Experience building production software, preferably with Python.\n\n - Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).\n\n - Strong product intuition and curiosity about how customers use software.\n\n - Excellent written and verbal communication.\n\n - High ownership—you naturally identify problems and solve them without waiting to be asked.\n\n - Comfortable operating in ambiguity and making decisions with incomplete information.\n\n - Excited by shipping quickly and learning from real users.\n\n\n\nBONUS POINTS\n\n - Experience at an early-stage startup.\n\n - Experience building developer tools or infrastructure products.\n\n - Open source contributions.\n\n - You've built and launched your own product.\n\n - Familiarity with AI infrastructure, LLMs, or developer platforms.\n\n\n\nWHY JOIN LITELLM?\n\n - Work directly with the founders every day.\n\n - Build products used by thousands of engineering teams around the world.\n\n - Own meaningful product decisions—not just implementation.\n\n - Move incredibly fast and see your work in production immediately.\n\n - Help define the future of AI infrastructure and developer tooling.\n\n - Competitive salary, equity, health, dental, and vision benefits.\n\n\n\nABOUT LITELLM\n\nLiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.\n\nIf you love talking to users, building products, and shipping software that people actually use, we'd love to meet you."},{"id":"08f17472-3c58-498f-a2ad-a0e45a302af6","title":"Senior Support Engineer - Brazil","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"Sao Paulo","secondaryLocations":[],"publishedAt":"2026-07-23T17:29:36.708+00:00","isListed":true,"isRemote":true,"workplaceType":"Remote","address":{"postalAddress":{"addressRegion":"","addressCountry":"Brazil","addressLocality":""}},"jobUrl":"https://jobs.ashbyhq.com/litellm/08f17472-3c58-498f-a2ad-a0e45a302af6","applyUrl":"https://jobs.ashbyhq.com/litellm/08f17472-3c58-498f-a2ad-a0e45a302af6/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About the Role
We're looking for a Senior Support Engineer in Brazil to own our support queue and drive our customers to success. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them.
The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it.
Responsibilities
Own the support queue and work through tickets to drive customers to success
Diagnose customer issues and solve for the root cause, not just the symptom
Reproduce customer issues in their specific environments
Submit pull requests for bug fixes and improvements where needed
Act as the technical voice of the customer back to engineering
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Metrics-driven and hardworking, ready to move through a high volume of tickets
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership
Competitive salary
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About the Role
We're looking for a Senior Support Engineer in India to own our support queue and drive our customers to success. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them.
The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it.
Responsibilities
Own the support queue and work through tickets to drive customers to success
Diagnose customer issues and solve for the root cause, not just the symptom
Reproduce customer issues in their specific environments
Submit pull requests for bug fixes and improvements where needed
Act as the technical voice of the customer back to engineering
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Metrics-driven and hardworking, ready to move through a high volume of tickets
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership
Competitive salary
Security Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Security Engineer to proactively protect LiteLLM at both the application and CI/CD levels.
About The Role
You will own LiteLLM’s security posture across application and supply chain domains. Your mandate is to ensure zero critical or high vulnerabilities and to proactively identify and neutralize attack vectors before they become risks. You’ll oversee application-level security, maintain secure CI/CD processes, and focus on offensive security improvements.
Responsibilities
Own all aspects of application-level security and maintain zero critical or high vulnerabilities
Proactively identify, assess, and remediate potential attack vectors across the platform
Protect LiteLLM by actively hunting vulnerabilities and ensuring robust defenses
Oversee CI/CD security and ensure secure release processes with zero supply chain incidents
Collaborate cross-functionally to embed security throughout development and deployment
Continuously improve and adapt security practices to address emerging threats
What We're Looking For
Experience at a startup (Seed to Series D) with a willingness to wear multiple hats
Strong background in security engineering and hands-on offensive or white-hat hacking
Demonstrated experience with application and CI/CD security
Security-related projects showcased on your resume, GitHub, or similar
Passion for proactive, offensive security
Evidence of winning past CTFs
Why Join LiteLLM?
Own the security mandate at a high-impact technical company
Fast-paced environment with deep technical ownership
Competitive salary and benefits
About LiteLLM
LiteLLM is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to secure LiteLLM’s future? Apply now!
","descriptionPlain":"Security Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Security Engineer to proactively protect LiteLLM at both the application and CI/CD levels.\n\n\nAbout The Role\n\nYou will own LiteLLM’s security posture across application and supply chain domains. Your mandate is to ensure zero critical or high vulnerabilities and to proactively identify and neutralize attack vectors before they become risks. You’ll oversee application-level security, maintain secure CI/CD processes, and focus on offensive security improvements.\n\n\nResponsibilities\n\n - Own all aspects of application-level security and maintain zero critical or high vulnerabilities\n\n - Proactively identify, assess, and remediate potential attack vectors across the platform\n\n - Protect LiteLLM by actively hunting vulnerabilities and ensuring robust defenses\n\n - Oversee CI/CD security and ensure secure release processes with zero supply chain incidents\n\n - Collaborate cross-functionally to embed security throughout development and deployment\n\n - Continuously improve and adapt security practices to address emerging threats\n \n\nWhat We're Looking For\n\n - Experience at a startup (Seed to Series D) with a willingness to wear multiple hats\n\n - Strong background in security engineering and hands-on offensive or white-hat hacking\n\n - Demonstrated experience with application and CI/CD security\n\n - Security-related projects showcased on your resume, GitHub, or similar\n\n - Passion for proactive, offensive security\n\n - Evidence of winning past CTFs\n \n\nWhy Join LiteLLM?\n\n - Own the security mandate at a high-impact technical company\n\n - Fast-paced environment with deep technical ownership\n\n - Competitive salary and benefits\n \n\nAbout LiteLLM\n\nLiteLLM https://github.com/BerriAI/litellm is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to secure LiteLLM’s future? Apply now!"},{"id":"7c8414be-5dc3-42e7-a194-0e0fac966ddf","title":"Staff Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-25T16:44:02.838+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/7c8414be-5dc3-42e7-a194-0e0fac966ddf","applyUrl":"https://jobs.ashbyhq.com/litellm/7c8414be-5dc3-42e7-a194-0e0fac966ddf/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Staff Software Engineer to own product quality across our testing, CI, and release systems.
You will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.
Own product quality end to end and drive regressions toward zero
Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes
Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship
Build canary and synthetic traffic detection to catch upstream provider drift before customers do
Own release channels so we ship daily at the edge while enterprise stays stable
Do real root cause analysis and turn every escaped defect into a permanent test
Raise the engineering bar through code and review, not through process documents
Experience at a startup (Seed to Series D) with a willingness to wear multiple hats
Built test or release infrastructure for a system with a large external integration surface, or maintained CI for an OSS project with heavy outside contribution
Strong debugging depth: can enter an unfamiliar codebase and find real root causes, not just symptoms
Opinions about what makes a test suite worth trusting
Track record of raising quality on a team without becoming the bottleneck
Open source contributions on GitHub or similar
Own the quality mandate at a high-impact technical company
Deep technical ownership, in the codebase, not in meetings
Fast-paced environment with real scale behind it
Competitive salary and benefits
LiteLLM is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to own quality at LiteLLM? Apply now!
","descriptionPlain":"STAFF SOFTWARE ENGINEER, PRODUCT QUALITY\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable access to LLMs and adjacent services. We're searching for a Staff Software Engineer to own product quality across our testing, CI, and release systems.\n\n\nABOUT THE ROLE\n\nYou will own LiteLLM's product quality across a surface area that spans 100+ provider integrations and a large volume of outside contributions. Your mandate is to make quality automatic at our scale, without slowing down how fast we ship. You'll build the conformance testing, CI, and release infrastructure that catches problems before they reach production, and you'll set the bar on the code paths that matter most.\n\n\nRESPONSIBILITIES\n\n - Own product quality end to end and drive regressions toward zero\n\n - Build a provider conformance test suite covering streaming, tool calling, structured output, error mapping, cost tracking, and auth modes\n\n - Own CI and release tooling that is fast, deterministic, and trusted enough that a red gate blocks a ship\n\n - Build canary and synthetic traffic detection to catch upstream provider drift before customers do\n\n - Own release channels so we ship daily at the edge while enterprise stays stable\n\n - Do real root cause analysis and turn every escaped defect into a permanent test\n\n - Raise the engineering bar through code and review, not through process documents\n\n\nWHAT WE'RE LOOKING FOR\n\n - Experience at a startup (Seed to Series D) with a willingness to wear multiple hats\n\n - Built test or release infrastructure for a system with a large external integration surface, or maintained CI for an OSS project with heavy outside contribution\n\n - Strong debugging depth: can enter an unfamiliar codebase and find real root causes, not just symptoms\n\n - Opinions about what makes a test suite worth trusting\n\n - Track record of raising quality on a team without becoming the bottleneck\n\n - Open source contributions on GitHub or similar\n\n\nWHY JOIN LITELLM?\n\n - Own the quality mandate at a high-impact technical company\n\n - Deep technical ownership, in the codebase, not in meetings\n\n - Fast-paced environment with real scale behind it\n\n - Competitive salary and benefits\n\n\nABOUT LITELLM\n\nLiteLLM https://github.com/BerriAI/litellm is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to own quality at LiteLLM? Apply now!"},{"id":"e0d55bf8-ab90-4aa6-ae48-f35c799489bd","title":"Technical Product Manager","department":"Product","team":"Product","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-07-30T17:49:33.447+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/e0d55bf8-ab90-4aa6-ae48-f35c799489bd","applyUrl":"https://jobs.ashbyhq.com/litellm/e0d55bf8-ab90-4aa6-ae48-f35c799489bd/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
We're looking for a Technical Product Manager who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
This isn't a traditional product management role, and it isn't a traditional software engineering role.
NOTE: You will spend 50% of your time coding, and 50% of your time talking to users.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.
Build new product features from concept to production.
Work directly with customers to understand pain points and validate solutions.
Ship quickly while maintaining a high quality bar.
Prototype new ideas and iterate based on user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Build intuitive developer experiences across our API, dashboard, and CLI.
Collaborate directly with the founders on product direction and technical decisions.
Help define and build LiteLLM's second major product.
Bachelor's or Master's degree in Computer Science or a related field.
Experience as a product manager or associate product manager at a company
Strong software engineering fundamentals.
Experience building production software, preferably with Python.
Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
Strong product intuition and curiosity about how customers use software.
Excellent written and verbal communication.
High ownership—you naturally identify problems and solve them without waiting to be asked.
Comfortable operating in ambiguity and making decisions with incomplete information.
Excited by shipping quickly and learning from real users.
Experience at an early-stage startup.
Experience building developer tools or infrastructure products.
Open source contributions.
You've built and launched your own product.
Familiarity with AI infrastructure, LLMs, or developer platforms.
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
","descriptionPlain":"TECHNICAL PRODUCT MANAGER\n\nLiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.\n\nWe're looking for a Technical Product Manager who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.\n\n\n\nABOUT THE ROLE\n\nThis isn't a traditional product management role, and it isn't a traditional software engineering role.\n\nNOTE: You will spend 50% of your time coding, and 50% of your time talking to users. \n\nYou'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.\n\nIf you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.\n\n\n\nRESPONSIBILITIES\n\n - Build new product features from concept to production.\n\n - Work directly with customers to understand pain points and validate solutions.\n\n - Ship quickly while maintaining a high quality bar.\n\n - Prototype new ideas and iterate based on user feedback.\n\n - Own major product areas and continuously improve them over time.\n\n - Design backend APIs and services using Python and FastAPI.\n\n - Build intuitive developer experiences across our API, dashboard, and CLI.\n\n - Collaborate directly with the founders on product direction and technical decisions.\n\n - Help define and build LiteLLM's second major product.\n\n\n\nWHAT WE'RE LOOKING FOR\n\n - Bachelor's or Master's degree in Computer Science or a related field.\n\n - Experience as a product manager or associate product manager at a company\n\n - Strong software engineering fundamentals.\n\n - Experience building production software, preferably with Python.\n\n - Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).\n\n - Strong product intuition and curiosity about how customers use software.\n\n - Excellent written and verbal communication.\n\n - High ownership—you naturally identify problems and solve them without waiting to be asked.\n\n - Comfortable operating in ambiguity and making decisions with incomplete information.\n\n - Excited by shipping quickly and learning from real users.\n\n\n\nBONUS POINTS\n\n - Experience at an early-stage startup.\n\n - Experience building developer tools or infrastructure products.\n\n - Open source contributions.\n\n - You've built and launched your own product.\n\n - Familiarity with AI infrastructure, LLMs, or developer platforms.\n\n\n\nWHY JOIN LITELLM?\n\n - Work directly with the founders every day.\n\n - Build products used by thousands of engineering teams around the world.\n\n - Own meaningful product decisions—not just implementation.\n\n - Move incredibly fast and see your work in production immediately.\n\n - Help define the future of AI infrastructure and developer tooling.\n\n - Competitive salary, equity, health, dental, and vision benefits.\n\n\n\nABOUT LITELLM\n\nLiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.\n\nIf you love talking to users, building products, and shipping software that people actually use, we'd love to meet you."},{"id":"f4b86291-3410-4e27-9c3e-8306609e3c59","title":"Forward Deployed Engineer","department":"Product","team":"Product","employmentType":"FullTime","location":"United States","secondaryLocations":[{"location":"San Francisco","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}}}],"publishedAt":"2026-08-07T04:18:57.855+00:00","isListed":true,"isRemote":null,"workplaceType":null,"address":null,"jobUrl":"https://jobs.ashbyhq.com/litellm/f4b86291-3410-4e27-9c3e-8306609e3c59","applyUrl":"https://jobs.ashbyhq.com/litellm/f4b86291-3410-4e27-9c3e-8306609e3c59/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Forward Deployed Engineer to help customers leverage the leading OSS AI gateway.
About the Role
We're looking for a Forward Deployed Engineer to own customer success @ LiteLLM. You will work with our most important accounts, and be responsible for meeting them regularly, helping with their rollouts, and unblocking them with any feature requests/bugs they might face.
This is a customer facing role, where the customer is developers. If you enjoy solving technical problems, and helping developers see success this is a great role for you.
Responsibilities
Own the 30 most important accounts at LiteLLM, and drive them to success
Serve as the technical point of contact for these accounts - in charge of making sure their issues are done, communicating regularly with the customer.
Prevent churn-risk by proactively identifying risk, improving and driving usage, and ensuring customers are renewal-ready. Your work here is critical to the company's overall success.
Drive product roadmap, by surfacing larger technical gaps/opportunities to the product team.
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Excellent customer-facing communication (clear writing, calm execution) + high responsiveness (Slack-first)
High autonomy (you figure out your own backlog and priorities, based on customer problems)
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits, 401k plan with 3.5% match.