Facts · 2020
events: 7 · Timeline
- AlphaFold 2 solves the protein structure prediction problem at CASP14Science · Health & medicine · Protein folding · siliconangle.com ↗
- The US Commerce Department expands the foreign direct product rule against Huawei: a license is also needed for chips made abroad using American technology; another 38 affiliates are added to the Entity ListGeopolitics & defense · Business & markets · Compute export controls · content.govdelivery.com ↗
- In GPT-3's training data Wikipedia is only 3% of the mix (3 billion tokens), yet the model saw it 3.4 times, versus less than once (0.44) for the bulk Common Crawl web dataMedia & information · Science · Wikipedia after AI · arxiv.org ↗
- GPT-3: 175 billion parameters, solves tasks from a few examplesScience · Large language model · arxiv.org ↗
- Cloudflare moves from reCAPTCHA to hCaptcha: Google plans to charge for reCAPTCHA, and, as Cloudflare writes, “Google's business is targeting users with advertising”Cybersecurity · Privacy & surveillance · Business & markets · Death of CAPTCHA · blog.cloudflare.com ↗
- The pandemic moves work and school onlineWork & jobs · Education · Health & medicine · Remote work · pubmed.ncbi.nlm.nih.gov ↗
- Jared Kaplan and co-authors at OpenAI describe scaling laws: a language model's loss falls as a power law as the number of parameters, the amount of data and training compute growScience · Large language model · arxiv.org ↗