Data Ops Leader, Annotations & Datasets

Company: Abridge
Location: San Francisco
Posted on: March 29, 2025

Job Description:

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most-their patients.Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense.The RoleAs the Data Annotation Leader, you'll play a pivotal role in enabling our AI applied science and product teams. This role is responsible for building the datasets needed to train and evaluate the next generation of models powering Abridge's products. This role is a unique opportunity to stand up a new function on a team that is reshaping the practice of medicine. You will work cross-functionally, collaborating closely with AI/ML scientists, product leaders, data engineers, and our legal team, developing processes to scale up data annotation efforts at Abridge.Key responsibilities include:

• Sourcing job specifications from stakeholders in scientists and product.
• Working with our commercial, legal, and security teams to identify and uphold all relevant data security and privacy requirements.
• Driving strategic decisions about which vendors to work with and when to spin up internal annotation processes.
• Quarterbacking engagements with vendors, working with finance and company leaders to negotiate strong deals.
• Overseeing the work to ensure the quality of work product and compliance with our requirements.What You'll Do

• Stay on top of the landscape of vendors, including both capabilities and economics.
• Drive strategic decisions about which annotation jobs to pursue with which vendor.
• Quarterback discussions and negotiations with vendors in partnership with finance and leadership.
• Ensure that our annotation investments align with Abridge's research and product priorities, communicating frequently with builder leadership.
• Work closely with scientists to produce clear specifications and identify appropriate datasets for each task.
• Be the point person in charge of each annotation effort, ensuring that all efforts meet our product needs, comply with our obligations, and are completed swiftly.
• Define and monitor quality metrics for annotation tasks.
• Work with our AI science and engineering teams to curate the resulting datasets for model training and evaluation (storage, versioning, access controls, etc.).What You'll Bring
  • 5+ years in data annotation, data operations, or related roles, with at least 2 years in a leadership position.
  • Experience working with annotation platforms (e.g., Labelbox, Scale AI, Supervisely).
  • Familiarity with the operations of machine learning research teams and the role of annotated data in model training.
  • Experience building and managing internal annotation teams.
  • Strong organizational and project management skills.
  • Experience working with cross-functional teams in a fast-paced, startup environment.Bonus Points If...
    • Basic scripting or data manipulation skills (e.g., Python, Excel) are advantageous but not required.
    • Experience in medical or conversational data annotation.
    • Understanding of ETL/ELT processes, data governance, and security best practices.
    • Experience with data management tools and frameworks (e.g., SQL, BigQuery, DBT/Airflow).
    • Experience working with Cloud providers (AWS/GCP/Azure).
    • Experience with healthcare data and knowledge of HIPAA compliance.Base Salary: $150,000 USD - $260,000+ USD per year + EquityThis position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week. Relocation assistance is available for candidates willing to move to San Francisco.Must be willing to travel up to 10%Why Work at Abridge?
      • Be a part of a trailblazing, mission-driven organization that is powering deeper understanding in healthcare through AI!
      • Opportunity to work and grow with talented individuals and have ownership and impact at a high-growth startup.
      • Flexible/Unlimited PTO - Salaried team members can take off as much approved time off as they need, plus 13 paid holidays.
      • Equity - For all salaried team members.
      • Medical insurance - We pay 100% of the premium for you + 75% for dependents.
      • Dental & Vision insurance - We pay 100% of the premium for you + 75% for dependents.
      • 401k Plan - Contribute pre-tax dollars toward retirement savings.
      • Paid Parental Leave - 16 weeks paid parental leave, for all full-time employees.
      • Flexible working hours - We care more about what you accomplish than what specific hours you're working.
      • Home Office Budget - We provide up to $1,600 in a one-time reimbursement to set up your home office.
      • Sabbatical Leave - 30 days of paid Sabbatical Leave after 5 years of employment.Diversity & InclusionAbridge is an equal opportunity employer. Diversity and inclusion is at the core of what we do. We actively welcome applicants from all backgrounds.
        #J-18808-Ljbffr

Keywords: Abridge, San Francisco , Data Ops Leader, Annotations & Datasets, Accounting, Auditing , San Francisco, California