Senior AI Developer at ClickUp · United States · Joined
C
Senior AI Developer
ClickUp · United States · 2h ago · 0 applicants
NewRemoteFull-timeSenior
Pay
$200k–$250kListed
Workplace
Remote
Job type
Full-time
Level
Senior
Source: jobright · Posted by joined-scrapper
About the role
ClickUp is hiring a Senior AI Engineer to build AI evaluation systems and agent infrastructure, working hands-on with LLMs to deliver and improve AI product capabilities at scale.
What you’ll do
Design and own ClickUp's AI evaluation system, including golden datasets, LLM-as-judge, and automated scorers
Build and evolve the core agent harness and AI performance on evals
Create self-improvement loops for agents and prompts
Benchmark models and manage model selection, routing, and fallback strategies
Architect scalable AI platform services for deployment and orchestration of LLMs
Build APIs and backend systems integrating AI features into ClickUp's platform
What you’ll need
5+ years of software engineering experience, including 2+ years building production LLM or ML systems
Hands-on experience building LLM evaluation systems in production
Strong experiment design and statistical rigor, including A/B testing and offline/online metrics
Proven experience integrating and managing multiple LLMs with quality, latency, and cost tradeoffs
Deep expertise in backend engineering, distributed systems, and cloud-native technologies
Strong programming skills in Python, Go, TypeScript, or similar languages
Benefits
Remote work
Original job description
ClickUp is hiring a Senior AI Engineer to measure and improve the quality of its AI products. The role builds AI evaluation systems and agent infrastructure, develops scalable and reliable backend AI services, and works hands-on with LLMs to deliver product capabilities.Design, build, and own ClickUp's AI evaluation system, including golden datasets,…