Member of Technical Staff, Training Performance Engineer at Cohere · United States · Joined
C
Member of Technical Staff, Training Performance Engineer
Cohere · United States · Just now · 0 applicants
NewRemoteFull-timeSenior
Pay
CA$295k–CA$535kListed
Workplace
Remote
Job type
Full-time
Level
Senior
Team: Pre-Training team · Source: jobright · Posted by joined-scrapper
About the role
Cohere seeks a Training Performance Engineer for its Pre-Training team to optimize large-scale language model training by improving throughput and accelerator utilization, removing bottlenecks, and building training and profiling tools.
What you’ll do
Optimize language-model training performance
Improve throughput and accelerator utilization
Remove bottlenecks in training processes
Develop training and profiling tools
What you’ll need
Extremely strong software engineering skills
Proficiency in Python and ML frameworks such as JAX, PyTorch, and XLA/MLIR
Experience writing GPU kernels using CUDA or Triton
Experience with large-scale distributed training strategies
Familiarity with autoregressive sequence models such as Transformers
Cohere is hiring a Member of Technical Staff, Training Performance Engineer for its Pre-Training team. The role focuses on optimizing language-model training performance by improving throughput and accelerator utilization, removing bottlenecks, and developing training and profiling tools.Extremely strong software engineering skillsProficiency in Python…