JAPAN WUT PODCAST 197 "AI ARMS RACE"
How did a leaked document from 2018 predict Japan’s connection to China’s supercharged AI programs? If 30% of Japan’s population become foreign-born, should they be entitled to vote? What is going on with Japan’s investments in AI agents?SHOW NOTESSOCIETY 5.0Over the past week, DeepSeek, a Chinese AI startup, released its R1 model, which outperforms leading AI models at a lower cost, causing a significant market reaction. Nvidia's stock plummeted, losing nearly $600 billion, due to DeepSeek's claim of using less advanced chips and debates over data usage. Security issues emerged as DeepSeek exposed sensitive data, leading to quick action to secure it.Japan's Chief Cabinet Secretary Hayashi has commented on the need to balance innovation with risk management regarding DeepSeek.In response, the U.S. Navy banned DeepSeek due to security concerns, and the Pentagon blocked its use after connections to Chinese servers. Nvidia shares slightly recovered, but the market remains volatile. In China, DeepSeek's success is celebrated, despite facing cyberattacks and scrutiny over data handling. One of DeepSeek's innovations was:Cold-Start Data Integration: Before applying reinforcement learning (RL), DeepSeek incorporates cold-start data, which includes carefully curated, long Chains of Thought (CoT) examples. This helps in refining the model's initial performance by addressing issues like endless repetition, poor readability, and language mixing, while also setting the stage for more effective RL.Italy blocks access to the Chinese AI application DeepSeek to protect users' data
