All roles

Machine Learning Evaluation Specialist (Remote)

Remote · USA Full-time New today

This a Full Remote job, the offer is available from: United States, Turkey, Greece, Estonia, Latvia, North Macedonia, Hungary, Bulgaria, Albania, Poland, Romania, Kosovo, Portugal, Spain, Malta, United Kingdom, Austria, Belgium, Germany, Ireland, France, Slovakia, Czechia, Italy, Montenegro, Bosnia and Herzegovina, Paraguay, Uruguay, Brazil, Dominican Republic, Venezuela, Ecuador, Colombia, Argentina, Chile, Bolivia, Peru, Mexico, Puerto Rico, Canada, Serbia, Arizona (USA), California (USA), Colorado (USA), Delaware (USA), District of Columbia (USA), Florida (USA), Georgia (USA), Idaho (USA), Illinois (USA), Indiana (USA), Louisiana (USA), Nevada (USA), North Carolina (USA), Ohio (USA), Oklahoma (USA), Pennsylvania (USA), Tennessee (USA), Texas (USA), Virginia (USA), Washington (USA) Machine Learning Evaluation Specialist (Remote) List of accepted countries and locations Important for US applicants: This is a 1099 independent contractor role and is not compatible with F-1 OPT, STEM OPT, or other visa statuses that require W-2 employment, guaranteed hours, or employer sponsorship. We are unable to provide offer letters or employment verification for this role. Help design the hardest ML problems state-of-the-art AI hasn't solved yet. We're hiring domain experts to build evaluation tasks that challenge the frontier of AI. This is not an ML engineering role — it's a research role. You'll use deep expertise in your field to create problems that general ML knowledge can't touch. What you'll do

  • Propose and frame original, research-grade ML problems rooted in your domain
  • Design evaluation tasks that require specialized knowledge well beyond standard pipelines
  • Assess AI-generated solutions for correctness, creativity, and methodological rigor — and explain exactly where and why they fall short
  • Document problem difficulty, required domain knowledge, and expected failure modes

What you need

  • Graduate-level expertise (MS or PhD preferred) in a scientific or technical domain that intersects with ML
  • Strong working knowledge of ML methods — model selection, feature engineering, evaluation metrics
  • Deep familiarity with active research problems in your field — you know where general ML knowledge runs out
  • Excellent written communication — you can articulate complex problems clearly and precisely. This cannot be overstated.
  • Self-motivated and comfortable working independently on intellectually demanding tasks

What you don't need

  • No prior AI training or RLHF experience required
  • No software engineering background needed — domain expertise and research instincts are what matter

Domains we're especially looking for

  • Computational Biology / Bioinformatics
  • Genomics / Molecular Biology
  • Physics / Astrophysics / Signal Processing
  • Climate / Environmental Modeling
  • Healthcare / Medical Imaging
  • Neuroscience / Brain-Computer Interfaces
  • Materials Science / Chemistry
  • Finance / Quantitative Modeling
  • Robotics / Control Systems / Reinforcement Learning
  • Advanced NLP (specialized domains)
  • Mathematics / Statistics (applied)

Logistics

  • Fully remote — work from anywhere
  • $200–$400/hr depending on domain and seniority
  • 10–40 hrs/week, hourly contract
  • Assessment required — paid if approved
  • Independent contractor (1099) — not compatible with F-1 OPT, STEM OPT, or visa statuses requiring W-2 employment or employer sponsorship

⚠️ This is a project-based, freelance opportunity with no guaranteed hours. We recommend keeping other work options open while waiting for project assignment. This offer from "G2i Inc." has been enriched by Jobgether.com and got a 75% flex score. Apply tot his job Apply To this Job

Related roles

Technical Project Manager (AI & Data )

Remote · USA Full-time

Learning Projects

Remote · USA Full-time

Data Science Project Manager

Remote · USA Full-time

Senior Consultant/Manager, Business Development, Skift Exec Search

Remote · USA Full-time

Senior Consultant, R&D Tax Credits, Income Tax

Remote · USA Full-time

Sr. Risk Analyst – Market Risk

Remote · USA Full-time

Sr/ Manager/ Marketing Operations

Remote · USA Full-time

Sr. Manager, Content Supply Chain Technology

Remote · USA Full-time

Remote Medical Claims Analyst – Freshers Welcome

Remote · USA Full-time

Medicare Claims Processor (Remote To Wisconsin Only)

Remote · USA Full-time

[Remote] Veterinary Technician Recruiter - Remote - Mission Pet Health

Remote · USA Full-time

Director, Member Engagement Platform (Temporary)

Remote · USA Full-time

Associate Dean of Nursing, Remote, USA

Remote · USA Full-time

Experienced Data Entry Specialist – Remote Opportunity with arenaflex

Remote · USA Full-time

Data Engineer - Information Analytics at Costco Wholesale: Transforming Data into Insights at $22/Hour

Remote · USA Full-time

Part-Time Operations & Admin Assistant – Amazon Store

Remote · USA Full-time

Developer/Programmer Analyst

Remote · USA Full-time

Experienced Remote Customer Service Agent – Delivering Exceptional Travel Experiences for Global Passengers at blithequark

Remote · USA Full-time

[Remote] Jr Data Operation Specialist - Brazil (PJ)

Remote · USA Full-time

Client Account Administrator (CAA) - Remote position - Foley, AL

Remote · USA Full-time