Greetings from a world where…
we all make sure to drag our favorite newsletters from the promotions tab to the primary tab, right?
…As always, the searchable archive of all past issues is here. Please please subscribe here to support ChinAI under a Guardian/Wikipedia-style tipping model (everyone gets the same content but those who can pay support access for all AND compensation for awesome ChinAI contributors).
Feature Translation: A Brief History of Large Models in Wudaokou
Context: If you’ve ever been an international student in Beijing, the Wudaokou area probably conjures up wonderful feelings. Please, take me back to those Thursday nights playing beer pong at Sugar Shack. For The Washington Post’s neighborhood guide, here’s Yifan Zhang on this magical neighborhood:
In this week’s feature translation, which takes us back to 2018, Wudaokou is where Chinese AI scholars gather to discuss the paradigm shift in language models marked by Google’s BERT. The neighborhood also becomes home to the Beijing Academy of Artificial Intelligence (BAAI), which plays a key role in the history of China’s large language model development. This longform Leiphone article (link to original Chinese) is written by Caixian Chen, who also co-authored an awesome history of Chinese University of Hong Kong as a cornerstone of China's computer vision Scene (ChinAI #201)
Key Passages: We begin with BERT:
A fun naming details about two different Chinese teams that wanted to name their models ERNIE (to compete with Sesame Street rival BERT):
The reaction after OpenAI releases GPT-3
Great details on computing power limitations:
A very important point to conclude. BAAI did not restrict the research freedom of its affiliated scholars, and almost all of them worked at other labs and universities.
This week’s translation takes us up to the launch of BAAI’s Wudao 1.0 and Wudao 2.0 models, which I analyzed over two years ago in ChinAI #145. Next week’s translation starts with a section titled “The Eve of ChatGPT.”
First half of FULL TRANSLATION: A Brief History of Large Models in Wudaokou
Thank you for reading and engaging.
*I didn’t read much else this week, but I’ll catch up next issue!
These are Jeff Ding's (sometimes) weekly translations of Chinese-language musings on AI and related topics. Jeff is an Assistant Professor of Political Science at George Washington University.
HI Jeff are you in DC region? ; i would love to meet to update visions ; on my side trying to start up EconomistDiary.com : AI Games: Architect Intelligence as
a game played everywhere especially by under 30s who see humanai (eg fei-fei li, hassabis, bard llm ...) with good llm models as what UN sdg 17 actually needs to be designed around
would love to see a beijing pack of intelligence architects
best chris macrae n bethesda + 1 240 316 8157 firstname.lastname@example.org
|Consequences what happens when America's richest programmer bill gates reviews Ezra Vogel- Asia-America's kindest connector.|
.. Macraes' last 100 trips to Asia - they started with dad Norman Macrae teen serving in allied bomber command (today's Myanmar)-
The Economist became min diary of Norman Macrae's half century of asian trips from Myanmar 1943 on- we archive that at normanmacrae.net economistjapan.com; connection of my 50 trips with 5 generations of my family in Asia only made full sense from 2001 and mostly
15 trips to Bangladesh thanks to interviews with Fazle Abed & friends 1 2 3 and young chinese scholars at his 80th birthday filled most gaps EconomistPoor.com .. Asia trips 1 to 51 india -1-3 1984-2004; indonesia 4-7 (1982-1994) ; singapore 8-10 (1982-1992) japan (11-17) 1985-2013; thailand (18.19) 1984-1995 ; malaysia (20-21) ; 1993 korea (22-23); 1990-2017 bangladesh (24-39) 2007-2018;
dubai (40,41) 2015,6; qatar(42) 2017; china (43-50) 2016-2019 hong kong 51 (1996) like 7 members of my scotttish family tree i have enjoyed the huge privilege of learning more about advancing the human lot from the two thirds who are asian than my own race caucasian