Founding Platform Engineer

Company: Letta Cloud
Location: San Francisco
Posted on: February 15, 2025

Job Description:

Our background is a company founded around the MemGPT project (). The founding team comes from the same research lab and PhD advisors at Berkeley that produced Spark (--' Databricks) and Ray (--' Anyscale). We have deep expertise in both AI and systems, are currently hiring a founding team of exceptional engineers to join us in building the next generation of LLM agent technology. You can read more about Letta on and .At Letta, we are building the platform for stateful agents. Letta agents are designed as services with a granular REST API enabling developers to easily integrate agents into their end applications. Letta's OSS framework allows developers to create stateful agents with memory and reasoning, while Letta Cloud (currently in a private beta) makes it possible to deploy agent services with zero infrastructure. We believe that in the future, AI applications will be built with stateful agent services, rather than stateless LLM services.As a platform engineer at Letta, you'll work cross functionally both as a software engineer on backend services and infrastructure engineer maintaining configuration and deployment. You will be responsible for ensuring the stability, security, and scalability of Letta's agent services. You will build out Letta's cloud infrastructure. You will also work closely with enterprise customers for on-prem / BYOC deployments of Letta, and build out systems for managing monitoring and updates across deployments.Responsibilities:

• Develop Letta's agent API services
• Engineer and maintain Letta's cloud infrastructure
• Build out observability and logging for Letta services
• Develop and maintain on-prem / BYOC deployments for enterprise customers
• Manage CI/CD pipelines for deployment and testingSkills:
  • Strong Python (or Typescript) programming skills
  • Experience working with and building backend services
  • Proficiency with cloud infrastructure (AWS, Azure, GCP) with an understanding of cloud networking, security, and cost optimization
  • Experience with IaC (Terraform)
  • Experience Kubernetes and familiarity with K8 deployment and configuration (e.g. Helm charts, configuring auto-scaling)
  • Familiarity with observability and monitoring tools such as Sentry, Prometheus, Grafana, or other similar technologies
  • Understanding of SQL databases (specifically Postgres), such as database indexing and performance tuningYou will be a strong fit for this role if:
    • You empathize with developers and understand the important of reliability for the services they build on top of
    • You know how to prioritize when there are a million things you wish you could fix, and are comfortable working with imperfect systems
    • You're excited about working with agents and helping developers build the next generation of AI applicationsOur hiring processWe are hiring a small, tight-knit team of exceptionally talented founding engineers. Every hire matters, so we take the hiring process very seriously.
    • Initial phone interview (30m video call): We want to learn more about your background, your skills, your opinions on open source AI, and why you want to work at an early stage AI startup.
    • Technical take-home (
    • Paid workday (in-person recommended): As the final step in the interview process, we'll simulate working together as closely as possible by giving you a real (or as close to real as possible) task to work on for a day - and paying for your time of course. If you live in the Bay Area, we highly recommend visiting our offices in-person! We're an in-person company, so working at our office will give you a great idea of what it will be like to join as a full-time member of the team.
      #J-18808-Ljbffr

Keywords: Letta Cloud, San Francisco , Founding Platform Engineer, Engineering , San Francisco, California