Kenji Watanabe
Researcher — pre-training, scaling, evaluation
ScreeningWarmSourcedPassiveUS citizen
AI match score
96
Last touched1w ago
OwnerMei Lin
Comp expectation$520,000–$720,000
Flight riskmedium
Projects
- Sparse Mixture-of-Experts scaling studyFirst author
Co-led a study on routing stability in MoE transformers at >100B parameter scale; proposed a gradient-balanced routing variant.
publicationStable routing for sparse MoE at scale — arXiv preprintcommitFollow-up blog postcommitLightning talk at internal summit - Open evals libraryMaintainer
Maintained an eval harness used by the broader team to track capability gains.
commitEval harness — OSS contributionspublicationConference poster