About the Role

Uber Scaled Solutions is one of Uber's biggest bets with the ambition to build one of the world's largest data foundries for AI applications and evolve into a platform of choice for a variety of online tasks. Data Labelling operations is one of the core functional teams within Uber Global Scaled Solutions (GSS) with the responsibility to oversee the end-to-end lifecycle of the data annotation programs for B2B clients. At its core, our ability to build industry-leading data annotation programs is our right to win in this space.

As a seasoned program manager for data labeling in the Gen AI space, you will be responsible for defining the programs and its key objectives to support LLM model training. You will drive cross-functional efforts across Operations, Product, Engg and Legal to define the Program-level Ops strategy, define scalable data labeling workflows leveraging internal tools, external vendors, and automation.

The role will also shape and lead Scaled Solutions task/ product/ feature launches and improvements by working closely with global Supply, product, and engineering teams.

You will be required to work with a geographically diverse team.

True to Uber values, we are looking for a leader with an owner" and go-get-it" mindset who is ready to scale a brand new business line. You need to be customer-obsessed and build with heart" ‌ while demonstrating ability to build the vision as well as roll up the sleeves and get into action to see the forest and the trees".

If you're passionate about re-imagining the gig marketplace for skilled workers and impacting the lives of millions of skilled gig workers while working with a top-tier team, this is the opportunity for you

What You'll Do

Define the roadmap and key objectives for data labeling projects to support generative AI initiatives.
Partner with stakeholders (Data Scientists, Machine Learning Engineers, and Product Managers) to identify data requirements and success criteria.
Design scalable data labeling workflows that leverage internal tools, external vendors, and automation.
Optimize workflows for efficiency, accuracy, and cost-effectiveness, incorporating active learning and pre-labeling techniques where appropriate.
Engage and manage relationships with data labeling vendors, ensuring timely delivery and adherence to quality standards.
Collaborate with cross-functional teams to align labeling efforts with broader AI model development timelines.
Implement robust quality assurance processes to validate labeled datasets against gold standards.
Use metrics such as inter-annotator agreement, precision/recall, and throughput to monitor quality and make improvements.
Manage program budgets, including vendor costs and internal resources.
Forecast resource requirements and ensure efficient allocation to meet deadlines.
Ensure compliance with data privacy regulations (e.g., GDPR, CCPA) and ethical guidelines in dataset creation.
Advocate for inclusive and unbiased labeling practices to mitigate bias in AI models.

Basic Qualifications

5+ years experience managing scaled operations programs with 1+ year experience in GenAI / model training
1+ years People Management experience, building and developing teams
Experience working in a fast-paced, ambiguous work environment
Bachelor's Degree obtained
Strong knowledge of machine learning concepts, particularly around supervised learning and training data needs.
Experience working with data annotation platforms and tools.
Proven track record of managing large-scale projects with cross-functional teams and external vendors

Preferred Qualifications

Experience in Generative AI, including text, image, or audio data labeling.
Familiarity with active learning, semi-supervised labeling, and human-in-the-loop systems.
Proficiency in data annotation tools and scripting languages (Python, SQL) to analyze datasets and processes.
Strong understanding of ethical AI and best practices for minimizing dataset bias.
Excellent written and verbal communication skills, with the ability to influence technical and non-technical stakeholders
Strong understanding of the gig economy landscape, freelancer behaviors, and recruitment strategies
Excellent project management skills, with a proven ability to juggle multiple priorities and deadlines
You are a builder who wants to be empowered to make big bets
Demonstrated ability to work independently and effectively across internal and external organizations
Ability to take initiative in a constantly-changing work environment
Exceptional written and verbal communication, and organizational skills

About the Team

At Uber, we reimagine the way the world moves for the better. There are several operations and technologies that enable this mission and Uber's GSS (Global Scaled Solutions) org leads many of those capabilities, such as data annotation for AI/ML innovation, app testing, localization/internationalization, map editing, digitization programs and more. We combine technology and human intelligence optimally to run scaled programs. To do this efficiently and with high quality, we have built industry leading tech and ops muscle and have now externalized the same.

The tech+ops solution coupled with Uber's strength of building a platform for flexible work will enable enterprises world-wide to accelerate their data, AI and product journeys. While we do this, we look forward to creating flexible earnings opportunities through online tasks for millions of people across the world. Together, our tech, operations expertise and platform for knowledge work are uniquely positioned to be the best-in-class human-in-the-loop solution for the industry.

As we build this new business line, our goal is to extend gigs to millions of eligible people looking for flexible work worldwide and also create complementary earnings opportunities for existing earners on Uber's platform

For San Francisco, CA-based roles: The base salary range for this role is USD$152,000 per year - USD$169,000 per year. You will be eligible to participate in Uber's bonus program, and may be offered an equity award & other types of comp. You will also be eligible for various benefits. More details can be found at the following link https://www.uber.com/careers/benefits.

Uber

New Jobs

Sr Program Manager, Ops