DeepSeek highlights some of China's key advantages: a deep pool of skilled software engineers, a vast domestic market, and government support via subsidies
and MAGA tensions X: Peiyi Wang / @sybilhyz : I hope this formula helps researchers with no experience in RL better understand the RL of LLMs. Additionally, I am grateful to have @pigjunebaba by my side to witness the miracle of RL. Peiyi Wang / @sybilhyz : Last year, I joined DeepSeek with no RL experience. While conducting Mathshepherd and DeepSeekMath research, I independently derived this unified formula to understand various training methods. It felt like an “aha moment”, though I later realized it was PG. Peiyi Wang / @sybilhyz : This unified formula has made me truly believe in the potential of RL. During the training of r1-zero, it was because of this formula that I was able to wait for and eventually witness r1-zero's aha moment.