Skip to content

All jobs

Copy of LLM Model Response Evaluation

Lifted, an Upwork Company™ · Remote, CA

Posted Aug 6, 2026

Prepare my application

We cannot send applications to this employer's form for you. We prepare yours from your CV, and you submit it yourself.

About the job

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria. - Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities. - The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities. - The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more. - Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions. - Each task will include detailed project guidelines within the evaluation platform. - 3+ years of hands-on experience in LLM / GenAI data evaluation. - Bachelor's Degree required - Ability to research unfamiliar topics using trusted sources and make well-supported judgments. - Comfortable evaluating content across multiple modalities Flexible and remote work Variable workload: Accept or decline tasks based on your availability No guaranteed hours: Workload may vary weekly

Similar jobs we can apply to for you

  • Associate Machine Learning Engineer

    Manulife · Hybrid, Toronto, CA · ML and AI engineer · 69,525 - 115,875 CAD / Year

    69,525 - 115,875 CAD / Year

    Posted Nov 17, 2026

  • Member of Technical Staff, Reinforcement Learning

    True Talent Solutions Partners · On site, Montréal, CA · ML and AI engineer · 250,000 - 400,000 USD / Year

    250,000 - 400,000 USD / Year

    Posted Nov 17, 2026

  • Senior AI Engineer

    ALO · Beverly Hills, CA · ML and AI engineer · 160,000 - 200,000 CAD / Year

    160,000 - 200,000 CAD / Year

    Posted Nov 17, 2026

  • Lead AI Engineer

    ALO · Beverly Hills, CA · ML and AI engineer · 180,000 - 220,000 CAD / Year

    180,000 - 220,000 CAD / Year

    Posted Nov 17, 2026