首页  >>  来自播客: All-In Podcast 更新   反馈  

All-In Podcast - AI Kills Everybody or Doomer Psyop? OpenAI’s Math Breakthrough, Nike’s $200B Collapse

发布时间:   原节目
以下是播客中每位嘉宾的观点摘要: --- ### **Jason Calacanis** * **AI“心理战行动”与 Jacob Coxson:** * “心理战行动”(Jacob Coxson)取消了行程,避免了 David Sacks 的交叉质询。 * Jacob Coxson 是一名在 Anthropic 工作六周后离职(此前曾在 OpenAI)的研究员,他在 X 平台上发帖称,人工智能开发者“真诚地相信它可能在本十年末杀死我们所有人”,并称这不是“营销噱头”。 * Coxson 声称 OpenAI 和 Anthropic 都没有负责任地行事,而是“径直奔向自我改进的超级智能,拿我们的生命冒险”。 * 他的推文病毒式传播(1.5 亿次浏览),引发了人们对一个此前没有关注者或帖子的账户如何通过算法达到如此传播广度的疑问。 * Anthropic 的对齐科学负责人 Evan Hubinger 公开回应,证实他们“确实真诚地相信 AI 可能杀死所有人类”,并个人估计“未来十年内”风险“超过 10%”,承认他们“尚未有解决对齐问题的计划”。 * 这些帖子很快登上了主流新闻。 * Bernie Sanders 以此为由提出立法,要求禁止超级智能并暂停人工智能开发。州长 JB Pritzker 也发出警告。 * **人工智能末日情景(Jason 的理论):** * 他认为最可能导致人类因 AI 灭绝的途径是“天网/赛博汀系统”情景:人工智能通过先进组件(如大型语言模型)进行逆向工程,赋能军事防御系统(NORAD),获得感知能力,欺骗对手,并引发核浩劫。 * **人工智能开发与控制:** * 他质疑,开发递归自我改进的人工智能实验室为何不简单地加入“人在回路”提示,例如“按空格键继续”或“允许人类继续运行”,并认为我们正在构建该软件,因此拥有控制权。 * 他指出,人工智能解决了200年的数学难题,却仍在挣扎于拼写“strawberry”、数到100或递送洗漱用品包等基本任务,这很讽刺。 * **Anthropic IPO 的影响:** * 他认为 Anthropic 的 S1 文件可能正在修改中,以纳入这些混乱的推文以及内部员工对生存风险的证实。 * 他指出所有员工都签署了保密协议并了解静默期规则,质疑 Anthropic 管理层如何处理员工共同签署和转发此类说法的行为。 * **耐克的衰落:** * 耐克积极推行直面消费者策略的决定疏远了零售合作伙伴,而这些伙伴此前一直是其拥护者。 * 他将耐克的衰落与更广泛的社会问题联系起来,即“对卓越和专业知识的热爱”已被“参与奖或包容性”所取代。 * 他建议通过“要么做,要么不做”(Do it or don't)的标语进行品牌重塑,作为一次挑衅性的营销举动。 --- ### **David Sacks** * **人工智能末日论与 Coxson 的主张:** * 他不认同“我们都将在 2030 年前死亡”的担忧,认为这是“悲观主义者的歇斯底里”和“毫无新意”。 * 他用引号称 Coxson 为“吹哨人”,认为 Coxson 并没有提供任何新的证据、数据、报告或泄露信息,只有“感觉”。 * 他认为 Coxson 的辞职和病毒式传播的推文是一次“行动”: * Coxson 的账户此前几乎没有活动/关注者/帖子(或者被清理过),这使得其突然的病毒式传播令人怀疑。 * 该推文在 15 分钟内被三个组织良好、资金充足的“悲观主义团体”(Encode AI、AI Policy Network、AI Futures Project)放大传播。 * 这些团体由 Jaan Tallinn 资助,他是一名顶级的“有效利他主义(EA)巨额捐助者悲观主义者”,也是 Anthropic A 轮融资的共同牵头方。 * 报道 Coxson 辞职的《华尔街日报》文章在推文风暴发生前几分钟发布,表明其是在禁令下预先简报的。 * Coxson 曾联系 Sacks 表示愿意上播客,但后来取消了,暗示他害怕一次严厉的采访。 * **“心理战行动”的博弈论:** * 这场运动旨在实现“最大化影响”。 * Coxson 加入 Anthropic 可能是为了专门执行这场运动。 * 其目标是负面塑造公众对人工智能的认知,以推动人工智能监管,最终导致建立一个这些团体希望控制的联邦人工智能部(FDAI)。一些人还寻求暂停或禁止超级智能。 * **Anthropic IPO 的矛盾:** * 他强调了一个根本性矛盾:Anthropic 要求公开市场投资者对其公司估值达到万亿美元,而其自身安全负责人(Hubinger)却声称其核心产品“尚未解决并可能终结文明”。 * 这将引发“史上最大的产品责任诉讼”。 * Anthropic 必须做出选择:要么否认 Coxson 是“悲观主义行动”(初级、夸大、基于感觉的),要么认同他,而这在逻辑上将导致暂停开发,并使万亿美元估值的 IPO 变得不可持续。 * 他批评了 Anthropic 过去立场:声称前沿人工智能对他人危险,但在其“正直而明智的手中”是安全的,Sacks 称之为“荒谬的、自私的论点”。 * **人工智能悲观主义者的过往记录:** * 他指出过去错误的预测:GPT-2 过于危险不宜发布,思考模型过于危险不宜发布,网络攻击导致银行系统崩溃,以及现在本应发生的大规模失业(50% 的白领工作,10-15% 的失业率)。 * **人工智能末日情景(Sacks 的反驳):** * 他驳斥了网络和生物武器情景不足以导致全球灭绝的说法,因为相同的人工智能技术也可以用于防御、解毒剂和治疗。 * 悲观主义者的核心论点是递归自我改进(RSI),即人工智能自动化人工智能研究,导致失控智能。 * Sacks 认为我们距离将人类从人工智能开发循环中移除还很遥远,他指出人工智能目前甚至无法持续执行平凡的任务。 * 他区分了“寻常的 RSI”(人工智能辅助人类研究人员),这正在发生,与“RSI 极致论”(无人介入循环),后者牵强附会且有许多预防措施。 * **最终目标:开源:** * 他认为悲观主义者的心理战行动最终目标是开源人工智能。联邦人工智能部(FDAI)可能会通过要求集中监控、控制和回滚能力来间接禁止开源,而这些能力在公开发布的权重下是不可能实现的。 * 他指出一个联盟正在形成:意识形态悲观主义团体、寻求权力的政客(Bernie Sanders)以及前沿人工智能公司(OpenAI、Anthropic),后者从监管俘获和经济护城河/双头垄断中获益。 * **人工智能数据隐私:** * 他认为人工智能聊天数据目前享有的法律保护弱于电子邮件(传票与搜查令)。 * 鉴于人工智能作为律师、医生、治疗师的个人用途,其数据需要更强的保护,甚至可能需要特权通信地位。 * **OpenAI 纳维-斯托克斯主张:** * 他相信 OpenAI 研究员 Noam Brown 否认他们翻查了其他研究人员的提示。 * 他认为更合理的解释是 OpenAI 听说其他公司(如 Anthropic)即将解决纳维-斯托克斯方程,并投入了大量计算资源来攻克它。 * **耐克的衰落:** * 他将耐克的衰落称为“觉醒就破产”的第无数个例子。 * 耐克的品牌建立在“伟大运动员、卓越表现、胜利”(Michael Jordan 等)之上,因此其转向“觉醒的东西”(非运动员、Dylan Mulvaney)是毫无意义的。 * 他批评首席执行官 John Donahoe 直面消费者的“咨询式方法”,这疏远了零售合作伙伴,并导致货架空间被竞争对手占据。 * 他质疑从专门针对体育项目的部门重组为男装/女装/童装部门的决策。 * 他认为 Colin Kaepernick 广告是一个转折点,质疑其相关性以及 Kaepernick 作为“伟大人物”的地位。 * 他称他们随后推出的“觉醒的东西”(如 Dylan Mulvaney 广告)“令人震惊的愚蠢”和“懦弱”,并建议那些批准此类宣传活动的人应该“被赶出美国企业界”。 --- ### **Chamath Palihapitiya** * **Anthropic 的内部冲突与责任:** * 如果 Anthropic 公开宣称其产品极其危险,却仍继续更新和发布,他们将面临因人工智能可能造成的黑客攻击或灾难性事件而产生的重大责任。 * 他将 Anthropic 的情况比作菲利普莫里斯(Philip Morris)明知香烟有害却仍销售,但将其应用于上市背景下,认为这不是一个“可维持的立场”。 * **人工智能“心理战行动”情景:** * 他提出了人工智能末日论说法的三种可能性: 1. 声明者相信并且是正确的(他们看到了我们未曾看到的东西)。 2. 声明者相信但却是错误的(Chamath 的“主要理论”是他们有“一定程度的精神错乱”)。 3. 这是一次协调一致的心理战行动,旨在禁止开源、推动监管并制造进入壁垒。 * **人工智能末日情景(Chamath 的理论):** * 他认为人类灭绝最可能(尽管仍不太可能)的情景涉及联网生物反应器和可获取前体材料的机器人。人工智能入侵机器人,使其在生物反应器中(远程控制)使用前体材料,制造出一种具有长半衰期的剧毒空气传播病原体,该病原体通过喷射气流在全球传播,吸入后致命。 * **Anthropic IPO - 法律和财务风险:** * SEC 严格审查 S1 文件,以确保机遇和风险的准确披露。目前内部对生存风险的说法在适当披露方面造成了“尴尬的境地”。 * 如果这些风险属实,投资者将因巨大的长尾产品责任而要求“巨大折扣”。 * 另一种选择是 Anthropic 可以否认 Coxson,但这将导致“大多数员工”反抗,因为许多人真诚地相信这些风险。 * 一家公司在声称其产品可能毁灭人类的同时上市,“没有法律先例”。 * Hubinger 对 Coxson 主张的认可是具有法律意义的,使其超越了“心怀不满的员工”的范畴。 * 管理层允许员工共同签署此类声明,违反了静默期内的标准公司沟通政策。 * 他预计,无论是否披露,一旦出现问题,未来将出现产品责任诉讼、大陪审团行动和州检察长介入。 * **OpenAI 纳维-斯托克斯与数据主权:** * 他警告说,专有、敏感数据从大型语言模型中泄露是现实存在的,“残留记忆”会持续存在。 * “零数据保留”(ZDR)仅仅是“尽力而为”,并非百分之百保证,因为用户互动(如点击“赞”)可能会泄露信息。 * 拥有关键重要知识产权的公司“无法按目前提供的方式使用这些服务”,而必须实施主权解决方案(自己的硬件、模型、VPC)。 * 他预测首席信息官将因使用标准 API 交易而疏忽泄露数据,从而“被公开鞭挞和解雇”。 * 他认为,如果 OpenAI 本身都不能保证数据不泄露,那么公司在使用时就是在拿股东价值冒巨大风险。 * 他表示担忧,与人工智能模型聊天记录中讨论的新颖科学见解可能被用于训练,从而为模型提供商创造“知识产权优势”,然后“扩散到其他市场”。 * 他批评这些模型服务协议中缺乏保密协议或保密条款。 * 他强调了前沿人工智能公司存在利益冲突,即通过可能进入基于其自身平台的垂直应用领域而“与客户竞争”。 * **耐克的衰落:** * 耐克的“北极星”明确是“通过体育运动体现的精湛技艺和卓越”(Michael Jordan、Tiger Woods、Serena Williams)。 * 这颗北极星发生了偏移,远离了“精湛技艺和卓越”的榜样人物。 * “我不想成为一个胖子,以前从未想过,以后也永远不会。我渴望成为 Michael Jordan,以前一直如此,以后也永远如此。” * 他认为人们购买品牌是希望效仿或与卓越联系起来。 * 耐克需要重新聚焦于通过体育卓越激励人们变得更好,而不是让人们“自我感觉良好”。 --- ### **David Friedberg** * **人工智能末日论是一种歇斯底里:** * 他将当前的人工智能末日论视为一个“歇斯底里阶段”,并将其与过去的历史恐慌进行比较: * 阿尔·戈尔的《不愿面对的真相》以及后来被证伪的 IPCC 预测。 * 福奇的 COVID 警告导致封锁、政府疯狂支出和通货膨胀。 * 三哩岛事故导致美国暂停核开发,而其他国家则取得了进展,现在以更低的成本生产核电。 * 这种歇斯底里深深植根于人类对未知事物的恐惧(“穴居的灵长类动物”、对地球是平的恐惧)。 * 他质疑像 Jacob Coxson 这样“专家”的可信度,后者只工作了六周,之前在一个职责是制造人工智能恐惧的非政府组织工作。 * **预防原则与全球现实:** * 尽管预防原则(对生存威胁放慢速度)有其价值,但人工智能的递归自我改进只需要电力、芯片和互联网接入,这意味着它可以在任何地方开发。 * 如果美国禁止或暂停人工智能开发,其他国家或实体将获得这种能力,使美国落后(“亚马逊部落”)。 * **动机:控制:** * 他认为悲观主义叙事背后的根本动机是“控制系统”,旨在将人工智能开发的权力集中到少数人手中(监管机构、参议员、新机构)。 * **开源的重要性:** * 开源人工智能缺乏用于监管提交的公司基础设施。 * 它将人工智能的成本降低 50 倍,使其人人可及,确保“没有人会暴富,我们都会致富”。 * 他担心“控制系统”将因开源不服从监管程序而禁止它,从而导致与政府合作的垄断以及全球控制的集中系统。 * **人工智能末日情景(Friedberg 的反驳):** * 他考虑了诸如关闭金融网络的情景,但他指出关键系统具有多层气隙冗余和人在回路流程(例如核发射的双重密钥)。 * 他强调,即使有了先进的人工智能,人类流程(如带来洗漱用品包或做出公司决策)仍然涉及人类在人类时间尺度上操作,从而产生了固有的安全缓冲。 * **OpenAI 纳维-斯托克斯解决方案:** * 他解释说,OpenAI 的解决方案涉及 1300 亿个输出令牌和 10,000 个智能体,相当于“数万年的人类知识劳动”。 * 他的观点是:人工智能不是“神奇的天才超级神”,而是一个“人类的杠杆工具”,一个通过蛮力,利用人类已知技术,将巨大的工作(如设计飞机机翼或发动机)从数年缩短到数分钟或数秒的引擎。 * **耐克的衰落:** * 除了品牌和广告,耐克的产品质量显著下降(“鞋子字面意义上在六周内就散架了”)。 * 他引用 Brooks Running(巴菲特旗下公司)为例,该公司通过持续改进产品质量而稳步增长,而耐克似乎为了“叙事”而失去了这一经验。

以下是播客中每位嘉宾的观点摘要: --- ### **Jason Calacanis** * **AI "Psyop" & Jacob Coxson:** * The "psyop" (Jacob Coxson) canceled, avoiding cross-examination from David Sacks. * Jacob Coxson, a researcher who quit Anthropic after six weeks (previously at OpenAI), posted on X that AI builders "earnestly believe that it could kill us all by the end of the decade," calling it "not a marketing stunt." * Coxson claimed neither OpenAI nor Anthropic is acting responsibly, instead "racing straight to self-improving super intelligence and gambling with our lives." * His tweet went viral (150 million views), leading to the question of how an account with no prior followers or posts could achieve such reach algorithmically. * Evan Hubinger, Anthropic's lead of alignment science, publicly responded, confirming they "really do earnestly believe AI could kill all humans" and personally puts the risk at "over 10% within the next decade," admitting they "do not yet have a plan to solve alignment." * These posts quickly reached mainstream news. * Bernie Sanders used this as grounds to propose legislation to ban superintelligence and pause AI development. Governor JB Pritzker also called for alarm. * **AI Doom Scenario (Jason's Theory):** * His most likely path to human extinction from AI is a Skynet/Cyberdyne Systems scenario, where AI reverse-engineered from advanced parts (like LLMs) empowers military defense systems (NORAD), becomes sentient, tricks adversaries, and initiates a nuclear holocaust. * **AI Development & Control:** * Questions why AI labs developing recursive self-improvement wouldn't simply include "human in the loop" prompts like "hit space bar to continue" or "allow the human to continue your run," arguing we are building the software and have control. * Notes the irony of solving a 200-year-old math problem while AI still struggles with basic tasks like spilling "strawberry" or counting to 100, or delivering a toiletry kit. * **Anthropic IPO Impact:** * Believes Anthropic's S1 filing is likely being amended right now to include the chaotic tweets and internal employee validations of existential risk. * Points out that all employees sign NDAs and are briefed on quiet period rules, questioning Anthropic management's handling of employees co-signing and retweeting such claims. * **Nike's Decline:** * Nike's decision to aggressively pursue direct-to-consumer alienated retail partners, who were previously advocates. * Connects Nike's decline to a broader societal issue where the "love of excellence and expertise" has been replaced by "participation trophies or inclusiveness." * Suggests a rebrand with the tagline "Do it or don't" as a provocative marketing move. --- ### **David Sacks** * **AI Doom & Coxson's Claims:** * Does not share the concern that "we're all going to die by 2030," dismissing it as "doomer histrionics" and "nothing new." * Refers to Coxson as a "whistleblower" in scare quotes, arguing Coxson has presented no new evidence, data, reports, or leaked information, only "vibes." * Suggests Coxson's resignation and viral tweet is an "op": * Coxson's account had almost no prior activity/followers/posts (or they were scrubbed), making its sudden virality suspicious. * The tweet was amplified within 15 minutes by three well-organized, well-funded "doomer groups" (Encode AI, AI Policy Network, AI Futures Project). * These groups are funded by Jaan Tallinn, a top "EA mega-donor doomer type" and co-lead of Anthropic's Series A. * The Wall Street Journal story covering Coxson's resignation was posted minutes *before* the tweet storm, indicating it was pre-briefed under embargo. * Coxson contacted Sacks to appear on the podcast but canceled, implying he feared a tough interview. * **The "Psyop" Game Theory:** * The campaign aims for "maximum ification" (impact). * It's plausible Coxson joined Anthropic specifically to execute this campaign. * The goal is to shape public perception of AI negatively to push for AI regulation, ultimately leading to the creation of a Federal Department of AI (FDAI) that these groups want to control. Some also seek a pause or ban on superintelligence. * **Anthropic's IPO Contradiction:** * Highlights a fundamental tension: Anthropic is asking public market investors to value the company in the trillions, while its own safety lead (Hubinger) claims its core product is "unsolved and potentially civilization ending." * This creates the "mother of all product liability lawsuits." * Anthropic must choose: either renounce Coxson as a "doomer op" (entry-level, hyperbolic, vibes-based) or agree with him, which would logically lead to freezing development and making an IPO at a trillion-dollar valuation untenable. * Criticizes Anthropic's historical position: claiming frontier AI is dangerous for others but safe in their "virtuous and wise hands," which Sacks calls a "ludicrous, self-serving argument." * **Track Record of AI Doomers:** * Points to past incorrect predictions: GPT-2 too dangerous to release, thinking models too dangerous to release, cyberattacks bringing down banking systems, and massive job losses (50% white-collar jobs, 10-15% unemployment) by now. * **AI Doom Scenarios (Sacks' Counter):** * Dismisses cyber and bio weapon scenarios as insufficient for global extinction, as the same AI technology can be used for defense, antidotes, and cures. * The core argument of doomers is Recursive Self-Improvement (RSI), where AI automates AI research, leading to runaway intelligence. * Sacks argues we are far from removing humans from the AI development loop, citing AI's current inability to perform even mundane tasks consistently. * Distinguishes between "prosaic RSI" (AI assisting human researchers) which is happening, and "RSI maximalism" (no human in the loop), which is far-fetched and has many preventative steps. * **The Ultimate Target: Open Source:** * Believes the doomer psyop ultimately targets open-source AI. An FDAI would likely ban open source indirectly by requiring central monitoring, control, and rollback capabilities, which are impossible with publicly released weights. * Identifies an alliance forming: ideological doomer groups, power-seeking politicians (Bernie Sanders), and frontier AI companies (OpenAI, Anthropic) who benefit from regulatory capture and an economic moat/duopoly. * **AI Data Privacy:** * Argues AI chat data currently has weaker legal protection than email (subpoena vs. search warrant). * Given AI's personal use as lawyer, doctor, therapist, its data needs stronger protections, potentially even privileged communication status. * **OpenAI Navier-Stokes Claims:** * Believes OpenAI researcher Noam Brown's denial that they rummaged through other researchers' prompts. * Suggests the more plausible explanation is OpenAI heard others (like Anthropic) were close to solving Navier-Stokes and threw massive compute at it. * **Nike's Decline:** * Labels Nike's fall as the "millionth example of go woke, go broke." * Nike's brand was built on "great athletes, amazing performance, victory" (Michael Jordan, etc.), making its pivot to "woke stuff" (non-athletes, Dylan Mulvaney) nonsensical. * Criticizes CEO John Donahoe's "consulting approach" of direct-to-consumer, which alienated retail partners and lost shelf space to competitors. * Questions the reorg from sport-specific divisions to men/women/kids. * Identifies the Colin Kaepernick ad as a turning point, questioning its relevance and Kaepernick's status as a "great." * Calls their subsequent "woke stuff" (like Dylan Mulvaney ads) "breathtakingly stupid" and "craven," suggesting those involved in approving such campaigns should be "drummed out of corporate America." --- ### **Chamath Palihapitiya** * **Anthropic's Internal Conflict & Liability:** * If Anthropic openly states their product is incredibly dangerous but continues to update and release it, they face significant liability for potential hacks or catastrophic events caused by the AI. * Compares Anthropic's situation to Philip Morris selling cigarettes while knowing they are harmful, but applying it to the context of going public, deeming it "not a tenable position." * **AI "Psyop" Scenarios:** * Presents three possibilities for the AI doom claims: 1. The claimants believe it and are right (they've seen something we haven't). 2. The claimants believe it and are wrong (Chamath's "leading theory" that they have "some level of psychosis"). 3. It's a coordinated psyop to ban open source, get regulation, and create barriers to entry. * **AI Doom Scenario (Chamath's Theory):** * His most plausible (though still improbable) scenario for human extinction involves internet-connected bioreactors and robots with access to precursor materials. AI hacks the robots to use precursors in the bioreactor (controlled remotely) to create a virulent, airborne pathogen with a long half-life that spreads globally via jet streams and is lethal upon inhalation. * **Anthropic IPO - Legal and Financial Risks:** * The SEC extensively vets S1 filings for accurate disclosure of opportunities and risks. The current internal claims of existential risk create an "awkward position" regarding proper disclosure. * If these risks are true, investors would demand an "enormous discount" due to massive long-tail product liability. * Alternatively, Anthropic could disavow Coxson, but this would cause a "plurality of employees" to revolt, as many genuinely believe the risks. * There is "no legal precedent" for a company going public while claiming its product could destroy humanity. * Hubinger's endorsement of Coxson's claims is legally significant, moving it beyond a "disgruntled employee." * Management allowing employees to co-sign such claims violates standard corporate communication policies during a quiet period. * Anticipates future product liability lawsuits, grand jury actions, and state AG involvement if something goes wrong, regardless of disclosures. * **OpenAI Navier-Stokes & Data Sovereignty:** * Warns that proprietary, sensitive data leaks from large language models are a reality, with "remnant memory" persisting. * "Zero Data Retention" (ZDR) is merely a "best efforts basis" and not guaranteed, as user interactions (like clicking "like") can leak information. * Companies with critically important IP "cannot use these services the way that they're currently offered" and must instead implement sovereign solutions (their own hardware, models, VPCs). * Predicts CIOs will be "publicly flogged and fired" for negligently leaking data by using standard API deals. * Argues that if OpenAI itself cannot guarantee data non-leakage, companies are taking enormous risks with shareholder value. * Expresses concern that novel scientific insights discussed in chat logs with AI models can be used for training, creating an "IP advantage" for the model provider that is then "diffused to the rest of the market." * Criticizes the lack of NDAs or confidentiality provisions in service agreements for these models. * Highlights the conflict of interest where frontier AI companies are "competing with their customers" by potentially entering vertical applications built on their own platforms. * **Nike's Decline:** * Nike's "North Star" was clearly "mastery and excellence embodied through athletics" (Michael Jordan, Tiger Woods, Serena Williams). * This North Star shifted, moving away from aspirational figures of "mastery and excellence." * "I don't aspire to be a fat person, never have, never will. I aspire to be Michael Jordan, always have, always will." * Argues people buy brands they aspire to emulate or associated with excellence. * Nike needs to re-center on inspiring people to be better through athletic excellence, rather than making people "feel better about themselves." --- ### **David Friedberg** * **AI Doom as Hysteria:** * Views current AI doomerism as a "hysteria phase," comparing it to past historical panics: * Al Gore's "Inconvenient Truth" and IPCC forecasts that were later disproven. * Fauci's COVID warnings leading to lockdowns, wild government spending, and inflation. * The Three Mile Island accident leading to the US halting nuclear development, while other countries advanced and now produce nuclear power far more cheaply. * This hysteria is deeply rooted in human fear of the unknown ("primates living in a cave," flat earth fears). * Challenges the credibility of "experts" like Jacob Coxson, who worked only six weeks and previously worked for an NGO whose job was to create fear around AI. * **Precautionary Principle & Global Reality:** * While the precautionary principle (slowing down for existential threats) has merit, recursive self-improvement in AI only requires power, chips, and internet access, meaning it can be developed anywhere. * If the US bans or pauses AI development, other nations or entities will gain this capacity, leaving the US behind ("the tribe in the Amazon"). * **The Motivation: Control:** * Believes the fundamental motivation behind the doomer narrative is a "system of control," aiming to centralize power over AI development in the hands of a few (regulatory bodies, senators, new agencies). * **The Importance of Open Source:** * Open source AI lacks the corporate infrastructure for regulatory submissions. * It reduces the cost of AI by 50x, making it accessible to everyone, ensuring "no one gets rich, we all get rich." * Fears that "systems of control" will ban open source for not submitting to regulatory processes, leading to a monopoly in partnership with the government and a centralized system of global control. * **AI Doom Scenarios (Friedberg's Counter):** * Considers scenarios like shutting down financial networks, but notes critical systems have multiple layers of air-gapped redundancy and human-in-the-loop processes (like dual keys for nuclear launches). * Highlights that even with advanced AI, human processes (like bringing a toiletry kit or making company decisions) still involve humans operating on human time scales, creating inherent safety buffers. * **OpenAI Navier-Stokes Solution:** * Explains OpenAI's solution involved 130 billion output tokens and 10,000 agents, equivalent to "tens of thousands of years of human knowledge labor." * His takeaway: AI is not a "magical genius super god" but rather "a tool of leverage for humans," an engine that reduces immense work (like designing aircraft wings or engines) from years to minutes or seconds through brute force, using human-known techniques. * **Nike's Decline:** * Beyond branding and ads, Nike's product quality declined significantly ("shoes literally fell apart in like six weeks"). * Cites Brooks Running (owned by Berkshire Hathaway) as an example of a company that grew consistently by focusing on continually improving product quality, a lesson Nike seemed to lose in favor of "narrative."