Machine Learning Engineer at Medilinkers LLC · New York, NY · Joined
ML
Machine Learning Engineer
Medilinkers LLC · New York, NY · Just now · 0 applicants
NewOn-siteFull-timeMiddle
Pay
$220k–$300kListed
Workplace
On-site
Job type
Full-time
Level
Middle
Source: jobright · Posted by joined-scrapper
About the role
Machine Learning Engineer to own the end-to-end evaluation and improvement loop for a multi-agent product, building evaluation pipelines and simulation agents to ensure robust entity representation changes.
What you’ll do
Define and maintain evaluations for changing entity representations in a multi-agent product
Build evaluation pipelines and simulation agents
Analyze traces to identify failures
Own the evaluation and improvement loop end to end
What you’ll need
Designed, built, and ran evals end to end (LLMs)
Production-quality Python with tests, maintenance, and release cadence
3+ years of experience designing and owning LLM evaluation
Proficiency in PyTorch, Hugging Face, and Weights & Biases
Original job description
Medilinkers LLC is hiring a Machine Learning Engineer to define and maintain evaluations for changing entity representations in a multi-agent product. The role builds evaluation pipelines and simulation agents, analyzes traces to identify failures, and owns the evaluation and improvement loop end to end.Not open to any visas (e.g. US citizen, Green Card…