Kenji Watanabe

Researcher — pre-training, scaling, evaluation

Member of Technical Staff, Pre-training at OpenAISan Francisco, CA · America/Los_Angeles14 yrs · IC6

ScreeningWarmSourcedPassiveUS citizen

AI match score

96/ 100

Strong

Last touched1w ago

OwnerMei Lin

Comp expectation$520,000–$720,000

Flight riskmedium

Sparse Mixture-of-Experts scaling study

First author · Sep 2023 — Present

Co-led a study on routing stability in MoE transformers at >100B parameter scale; proposed a gradient-balanced routing variant.

Adopted internally; paper cited widely in the community.

Evidence of the project's output.