产品内容工程负责人

Own the evaluation rubrics for image and video generation models, define the quality dimensions, scales and decision rules, and maintain them as models and capabilities evolve.

Design and run human eval rounds that produce training and fine-tuning signal, including prompt set construction, golden sets and side-by-side model comparisons.

Set and defend the launch quality bar for generative media features, and make clear go / no-go quality recommendations.

Calibrate and manage rater pools and vendor teams; monitor inter-rater reliability and drive measurable improvements in agreement.

Partner with research and modeling teams to translate eval findings into model, data and post-training priorities.

Scale human judgment into automated measurement (LLM-as-a-judge, auto-metrics) and validate automated scores against human ground truth.

Lead through collaboration, mentoring other content engineers on eval craft and rubric design.

Stay ahead of the generative media landscape, benchmarking against competitive and open-source model output.

Deliver high-quality evaluation work on model and launch timelines in a fast-paced, dynamic environment.

10+ years of experience in video production, content strategy, editorial standards, media evaluation or relevant fields

Experience authoring evaluation rubrics for video and/or image quality, including dimension design, rating scales, tie-breaking rules and annotator guidelines

Hands-on video production expertise, direction, shooting, editing, post and/or VFX, with the craft vocabulary to diagnose quality failures precisely

Experience evaluating generative media output (text-to-video, image-to-video, video-to-video, text-to-image) and diagnosing model failure modes

Experience partnering with AI/ML research or modeling teams, translating evaluation results into training, data or model-behavior recommendations

Experience running human evaluation programs at scale: rater calibration, inter-rater reliability, golden sets, quality audits

Proven ability to build influence and drive alignment across product, engineering, design, research and analytics partners

Familiarity with generative media tooling and model families, and with prompt engineering for media generation

Experience with annotation platforms, eval tooling and data pipelines supporting model training

Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies

Meta builds technologies that help people connect, find communities, and grow businesses.

When Facebook launched in 2004, it changed the way people connect.

Apps like Messenger, Instagram and WhatsApp further empowered billions around the world.

Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology.

People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

For those who live in or expect to work from California if hired for this position, please click here for additional information.

Individual compensation is determined by skills, qualifications, experience, and location.

Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable.

In addition to base compensation, Meta offers benefits.

Learn more about benefits at Meta.

Meta is proud to be an Equal Employment Opportunity employer.

We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.

You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures.

If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.

Take the first step toward a rewarding career at Meta.

Apply now APPLY NOW Find your role Explore jobs that match your skills and experience. Search by technology, team or location to find an opening that’s right for you. View jobs

Recruiters can view your conversations with AI. Using AI is optional and does not impact the outcome of your application process.Learn more about AI usage and settings.

We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.

You may view our Equal Employment Opportunity notice here.

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support.

If you need assistance or an accommodation due to a disability, fill out the Accommodations request form Notice regarding automated employment decision tools in New York City Learn more about this here.

©2026 Meta.

10+ years of experience in video production, content strategy, editorial standards, media evaluation, or relevant fields.

Experience authoring evaluation rubrics for video and/or image quality, including dimension design, rating scales, tie-breaking rules, and annotator guidelines.