Senior Backend Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.
About The Role
You’ll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.
Responsibilities
Build and scale our product, ensuring performance, reliability, and continuous improvement.
Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables
Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents
Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end users
Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems
Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics)
Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)
What We’re Looking For
Bachelor’s or Master’s in Computer Science or related field
1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)
Understanding of logging best practices, error handling, and secure backend development
Exposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)
Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)
Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilities
Eagerness to tackle hard bugs and ensure system transparency for end users
Why Join LiteLLM?
High-impact, mission-critical work on the core of compliance and reliability
Contribute directly to features used by enterprise customers at global scale
Fast-paced growth environment with room for technical ownership
Competitive salary, health, dental, and vision benefits
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to shape the future of secure, observable AI infrastructure? Apply now!
","descriptionPlain":"Senior Backend Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Senior Backend Engineer to help us build rock-solid guardrails and observability tooling at scale.\n\n\n\nAbout The Role\nYou’ll focus on owning our guardrails and logging world-class. You will be in charge of the backend code that ensures all guardrail calls are consistently logged, errors are surfaced to users (not silently swallowed), and our observability instrumentation works for real-world, high-volume traffic. Your attention to detail in areas like latency metrics, logging traceability, and backend guardrail registration will directly impact user trust in our security and compliance features.\n\n\n\nResponsibilities\n\n - Build and scale our product, ensuring performance, reliability, and continuous improvement.\n\n - Ensure all guardrail and policy enforcement calls (e.g., applyguardrail) are properly logged and traceable through our SpendLogs and relevant database tables\n\n - Build and design CPU-level guardrails to cover common attacks on LLM API's / MCP servers / Agents\n\n - Identify and fix areas where silent failures occur in guardrail creation, registration, and policy application—ensuring robust error handling and transparency to end users\n\n - Work with observability integrations, including Datadog, Splunk, Prometheus, and OpenTelemetry, to maintain accurate, configurable, and usable monitoring and logging for backend systems\n\n - Enhance observability integrations to work for 1B+ requests/mo., with minimal latency overhead and no memory leaks (e.g. due to cardinality of Prometheus metrics)\n\n - Collaborate cross-functionally on backend engineering priorities (performance, reliability, security)\n\n\n\nWhat We’re Looking For\n\n - Bachelor’s or Master’s in Computer Science or related field\n\n - 1+ years of experience with Python and backend frameworks (e.g. FastAPI, Flask)\n\n - Understanding of logging best practices, error handling, and secure backend development\n\n - Exposure to monitoring, logging, or metrics platforms (Datadog, Splunk, Prometheus, OpenTelemetry)\n\n - Familiarity with database integration and troubleshooting (PostgreSQL, Redis, etc.)\n\n - Driven to deliver high-quality backend code with strong guardrails, auditing, and debugging capabilities\n\n - Eagerness to tackle hard bugs and ensure system transparency for end users\n\n\n\nWhy Join LiteLLM?\n\n - High-impact, mission-critical work on the core of compliance and reliability\n\n - Contribute directly to features used by enterprise customers at global scale\n\n - Fast-paced growth environment with room for technical ownership\n\n - Competitive salary, health, dental, and vision benefits\n\n\n\nAbout LiteLLM\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\n\n\nReady to shape the future of secure, observable AI infrastructure? Apply now!"},{"id":"e2dacd9d-3be1-4a7d-8599-950ebcd61b95","title":"Engineering Manager","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-06-12T18:30:47.455+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/e2dacd9d-3be1-4a7d-8599-950ebcd61b95","applyUrl":"https://jobs.ashbyhq.com/litellm/e2dacd9d-3be1-4a7d-8599-950ebcd61b95/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About The Role
You own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.
Responsibilities
Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to
Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync
Drive well-architected, consistent code patterns across the team
Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites
Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution
Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed
Look out for the open-source community and protect open-source adoption as the team scales
What We're Looking For
Been an EM before, with a track record of managing and shipping through a team
Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes
Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)
Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after
Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact
Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate
Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after
Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar
CS/engineering degree or equivalent hands-on engineering background
Worked at a startup, familiar with messy codebases and doing rewrites
Bonus: did this at an open-source company
Bonus: scaled the eng team at a fast-growing startup
Why Join LiteLLM?
High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway
Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting
Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down
A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater
High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it
Competitive salary, health, dental, and vision benefits
About LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to lead the team behind the most widely adopted AI gateway? Apply now!
","descriptionPlain":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.\n\nAbout The Role\nYou own the outcomes, the process, and the team. You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community. You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy. This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO. It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.\n\nResponsibilities\n\n - Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to\n\n - Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync\n\n - Drive well-architected, consistent code patterns across the team\n\n - Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites\n\n - Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution\n\n - Analyze capacity needs, define the roles, and hire the engineers when more capacity is needed\n\n - Look out for the open-source community and protect open-source adoption as the team scales\n\nWhat We're Looking For\n\n - Been an EM before, with a track record of managing and shipping through a team\n\n - Metrics-driven: has stood up reliability or productivity metrics (on-time ship rate, regressions per release, MTTR) and used them to find root causes\n\n - Has kept quality high on a fast-moving production system, with evidence of driving an incident or regression rate down (e.g. took P0s from X to Y)\n\n - Root-cause and incident management: can point to incidents they ran postmortems on and the recurrence rate dropping after\n\n - Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact\n\n - Goal-setting and accountability: has improved a team's on-time delivery or commitment-hit rate\n\n - Customer-facing when it counts: has owned enterprise escalations and can show trust or retention held up after\n\n - Hiring and scaling: has filled a defined headcount plan and can speak to time-to-hire and quality bar\n\n - CS/engineering degree or equivalent hands-on engineering background\n\n - Worked at a startup, familiar with messy codebases and doing rewrites\n\n - Bonus: did this at an open-source company\n\n - Bonus: scaled the eng team at a fast-growing startup\n\nWhy Join LiteLLM?\n\n - High ownership: you own engineering productivity, quality, hiring, and the team's execution for the leading OSS AI gateway\n\n - Director-level scope, clear path: four areas under you and a direct line to Head of Engineering. Real scope now, not after years of waiting\n\n - Work directly with the CTO: you report to the founder/CTO and help set direction, not execute someone else's plan three layers down\n\n - A genuinely hard technical problem: 100+ provider integrations, a Rust migration, and day-zero model launches. The challenge is real and interesting, not process theater\n\n - High impact, in public: we work with NASA, Stripe, Adobe, and 84.51, and the work is open source. You'd be the person who scaled how LiteLLM is built, and the community sees it\n\n - Competitive salary, health, dental, and vision benefits\n\nAbout LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to lead the team behind the most widely adopted AI gateway? Apply now!"},{"id":"3f326076-7415-46a1-921e-8a1b1d6ee2b6","title":"Rust Engineer","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"San Francisco","secondaryLocations":[],"publishedAt":"2026-06-16T17:18:01.841+00:00","isListed":true,"isRemote":false,"workplaceType":"OnSite","address":{"postalAddress":{"addressRegion":"California","addressCountry":"United States","addressLocality":"San Francisco"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/3f326076-7415-46a1-921e-8a1b1d6ee2b6","applyUrl":"https://jobs.ashbyhq.com/litellm/3f326076-7415-46a1-921e-8a1b1d6ee2b6/application","descriptionHtml":"Rust Engineer
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
About The Role
You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.
Responsibilities
Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.
Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.
Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
What We're Looking For
Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.
Obsessive about performance. You care about latency and throughput at a level most engineers don't.
Strong instinct for stability, with a track record of balancing ambitious change against reliability.
Major bonus: prior experience leading codebase migrations from another language to Rust.
Major bonus: a demonstrated history of shipping performance-critical systems.
Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
Why Join LiteLLM?
Own one of the most important technical bets in the company's roadmap.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits.
About LiteLLM
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.
Ready to make LiteLLM the fastest AI gateway ever? Apply now!
","descriptionPlain":"Rust Engineer\n\nLiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.\n\nAbout The Role\n\nYou'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.\n\nThis is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration.\n\nResponsibilities\n\n - Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.\n\n - Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic.\n\n - Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.\n\n - Restructure the existing codebase so it's positioned for a clean, incremental move to Rust.\n\n - Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.\n\n - Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.\n\nWhat We're Looking For\n\n - Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold.\n\n - Obsessive about performance. You care about latency and throughput at a level most engineers don't.\n\n - Strong instinct for stability, with a track record of balancing ambitious change against reliability.\n\n - Major bonus: prior experience leading codebase migrations from another language to Rust.\n\n - Major bonus: a demonstrated history of shipping performance-critical systems.\n\n - Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.\n\nWhy Join LiteLLM?\n\n - Own one of the most important technical bets in the company's roadmap.\n\n - Define the architectural foundation that the entire platform will run on.\n\n - Fast-paced growth environment with deep technical ownership.\n\n - Competitive salary, health, dental, and vision benefits.\n\nAbout LiteLLM\n\nLiteLLM (https://github.com/BerriAI/litellm) is a Python SDK and Proxy Server enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by industry leaders worldwide.\n\nReady to make LiteLLM the fastest AI gateway ever? Apply now!"},{"id":"8d6724de-8d9f-4db3-bf6c-4e44da296bc3","title":"Account Executive","department":"Sales","team":"Sales","employmentType":"FullTime","location":"Remote","secondaryLocations":[],"publishedAt":"2026-06-22T22:08:21.936+00:00","isListed":true,"isRemote":true,"workplaceType":"Remote","address":{"postalAddress":{"addressCountry":"United States"}},"jobUrl":"https://jobs.ashbyhq.com/litellm/8d6724de-8d9f-4db3-bf6c-4e44da296bc3","applyUrl":"https://jobs.ashbyhq.com/litellm/8d6724de-8d9f-4db3-bf6c-4e44da296bc3/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built.
We're looking for a Account Executive with experience in selling developer tools (e.g. gitlab, datadog, etc.) to large companies (>1k+ employees). You’ll own the sales cycle from qualified opportunity to close, working closely with the founders and early sales team. As the first sales hire, you will be working closely with the Founders (ex-Microsoft, ex-Coinbase) to help us transition from a founder-led sales motion to a scalable sales motion as we continue to grow at an exponential rate in 2025.
Own the Sales Process: Manage the entire sales cycle from qualified lead to close, including discovery, demo, proposal, and negotiation.
Drive Revenue: Work with the founders to help LiteLLM hit it’s revenue goals.
Customer Feedback Loop: Collaborate with product and engineering by sharing insights from customer conversations.
Build Repeatable Processes: Establish repeatable sales processes that will scale as the company grows.
Build the Sales Team: As we grow, you will also be responsible for building the future sales team by helping define KPIs, hiring criteria, and culture.
You love working with developers (30k+ Github stars)
You want to work hard (need to be always on - calls on weekends/post-dinner/etc.)
You want to learn how AI is transforming businesses (Businesses run ALL LLM calls through LiteLLM)
You enjoy building things from scratch (defining GTM, sales playbook, hiring)
2-4+ years of experience in full-cycle B2B sales, ideally in SaaS or tech startups. Experience selling to regulated industries (e.g. insurance, financial services) is a strong plus.
Proven track record of meeting or exceeding quota.
Excellent communication and storytelling skills, with the ability to tailor messaging to diverse buyer personas.
Self-starter who thrives in an early-stage environment and is excited to help build sales processes from the ground up
Strong organizational skills, with the ability to manage multiple opportunities through various stages of the sales pipeline.
Comfortable with CRM tools, sales automation platforms, and a fast-paced, feedback-driven culture.
Own one of the most important technical bets in the company's roadmap.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits.
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About the Role
We're looking for a Senior Support Engineer to own our support queue and drive our customers to success. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them.
The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it.
Responsibilities
Own the support queue and work through tickets to drive customers to success
Diagnose customer issues and solve for the root cause, not just the symptom
Reproduce customer issues in their specific environments
Submit pull requests for bug fixes and improvements where needed
Act as the technical voice of the customer back to engineering
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Metrics-driven and hardworking, ready to move through a high volume of tickets
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership.
Competitive salary, health, dental, and vision benefits, 401k plan with 3.5% match.
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
We're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.
This isn't a traditional product management role, and it isn't a traditional software engineering role.
You'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.
If you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.
Build new product features from concept to production.
Work directly with customers to understand pain points and validate solutions.
Ship quickly while maintaining a high quality bar.
Prototype new ideas and iterate based on user feedback.
Own major product areas and continuously improve them over time.
Design backend APIs and services using Python and FastAPI.
Build intuitive developer experiences across our API, dashboard, and CLI.
Collaborate directly with the founders on product direction and technical decisions.
Help define and build LiteLLM's second major product.
Bachelor's or Master's degree in Computer Science or a related field.
Strong software engineering fundamentals.
Experience building production software, preferably with Python.
Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).
Strong product intuition and curiosity about how customers use software.
Excellent written and verbal communication.
High ownership—you naturally identify problems and solve them without waiting to be asked.
Comfortable operating in ambiguity and making decisions with incomplete information.
Excited by shipping quickly and learning from real users.
Experience at an early-stage startup.
Experience building developer tools or infrastructure products.
Open source contributions.
You've built and launched your own product.
Familiarity with AI infrastructure, LLMs, or developer platforms.
Work directly with the founders every day.
Build products used by thousands of engineering teams around the world.
Own meaningful product decisions—not just implementation.
Move incredibly fast and see your work in production immediately.
Help define the future of AI infrastructure and developer tooling.
Competitive salary, equity, health, dental, and vision benefits.
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
","descriptionPlain":"PRODUCT ENGINEER\n\nLiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.\n\nWe're looking for a Product Engineer who wants to work directly with the founders to figure out what developers need, ship quickly, and build products that thousands of engineering teams use every day.\n\n\n\nABOUT THE ROLE\n\nThis isn't a traditional product management role, and it isn't a traditional software engineering role.\n\nYou'll spend your time talking to customers, understanding their problems, designing solutions, writing production code, and shipping features. One week you might build a new authentication flow, the next week you're redesigning an onboarding experience, integrating with a new provider, or launching an entirely new product.\n\nIf you enjoy owning a problem end-to-end—from idea to production—you'll thrive here.\n\n\n\nRESPONSIBILITIES\n\n - Build new product features from concept to production.\n\n - Work directly with customers to understand pain points and validate solutions.\n\n - Ship quickly while maintaining a high quality bar.\n\n - Prototype new ideas and iterate based on user feedback.\n\n - Own major product areas and continuously improve them over time.\n\n - Design backend APIs and services using Python and FastAPI.\n\n - Build intuitive developer experiences across our API, dashboard, and CLI.\n\n - Collaborate directly with the founders on product direction and technical decisions.\n\n - Help define and build LiteLLM's second major product.\n\n\n\nWHAT WE'RE LOOKING FOR\n\n - Bachelor's or Master's degree in Computer Science or a related field.\n\n - Strong software engineering fundamentals.\n\n - Experience building production software, preferably with Python.\n\n - Comfortable moving across the stack when needed (backend, frontend, infrastructure, APIs).\n\n - Strong product intuition and curiosity about how customers use software.\n\n - Excellent written and verbal communication.\n\n - High ownership—you naturally identify problems and solve them without waiting to be asked.\n\n - Comfortable operating in ambiguity and making decisions with incomplete information.\n\n - Excited by shipping quickly and learning from real users.\n\n\n\nBONUS POINTS\n\n - Experience at an early-stage startup.\n\n - Experience building developer tools or infrastructure products.\n\n - Open source contributions.\n\n - You've built and launched your own product.\n\n - Familiarity with AI infrastructure, LLMs, or developer platforms.\n\n\n\nWHY JOIN LITELLM?\n\n - Work directly with the founders every day.\n\n - Build products used by thousands of engineering teams around the world.\n\n - Own meaningful product decisions—not just implementation.\n\n - Move incredibly fast and see your work in production immediately.\n\n - Help define the future of AI infrastructure and developer tooling.\n\n - Competitive salary, equity, health, dental, and vision benefits.\n\n\n\nABOUT LITELLM\n\nLiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.\n\nIf you love talking to users, building products, and shipping software that people actually use, we'd love to meet you."},{"id":"08f17472-3c58-498f-a2ad-a0e45a302af6","title":"Senior Support Engineer - Brazil","department":"Engineering","team":"Engineering","employmentType":"FullTime","location":"Sao Paulo","secondaryLocations":[],"publishedAt":"2026-07-23T17:29:36.708+00:00","isListed":true,"isRemote":true,"workplaceType":"Remote","address":{"postalAddress":{"addressRegion":"","addressCountry":"Brazil","addressLocality":""}},"jobUrl":"https://jobs.ashbyhq.com/litellm/08f17472-3c58-498f-a2ad-a0e45a302af6","applyUrl":"https://jobs.ashbyhq.com/litellm/08f17472-3c58-498f-a2ad-a0e45a302af6/application","descriptionHtml":"LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for an Engineering Manager to lead the team building the leading OSS AI gateway.
About the Role
We're looking for a Senior Support Engineer in Brazil to own our support queue and drive our customers to success. Because LiteLLM is a developer tool, this person needs to be technical. You'll dig into our customers' issues, understand them deeply, and unblock them.
The core of this role is simple: work the queue, address tickets, and make our customers successful with the product. We're looking for someone who is obsessed with getting to the root cause of problems rather than applying surface-level fixes. The best people in this role understand the real depth of a problem before they solve it.
Responsibilities
Own the support queue and work through tickets to drive customers to success
Diagnose customer issues and solve for the root cause, not just the symptom
Reproduce customer issues in their specific environments
Submit pull requests for bug fixes and improvements where needed
Act as the technical voice of the customer back to engineering
What We're Looking For
Technical depth and real familiarity with the LiteLLM product surface
Obsessed with customers and making them successful with the product
Obsessed with solving root causes rather than patching over problems
Metrics-driven and hardworking, ready to move through a high volume of tickets
A strong bias toward understanding problems deeply
Why Join LiteLLM?
Fast-paced growth environment with deep technical ownership
Competitive salary