首页  >>  来自播客: a16z 更新   反馈  

a16z - Why Specialized AI Could Beat The God Model

发布时间:   原节目
在最近一期A's and Z播客中,来自Open Router的Alex讨论了该公司被Stripe重大收购一事,他将此次收购描述为在七月份初步讨论后“相当迅速”地发生的。Alex强调了Open Router和Stripe在共同使命上的相互契合,即培养一个拥有众多新公司而非少数大公司的世界。这种契合,加上Stripe“创始人友好”的方式,说服了Open Router继续进行,使他们能够保留对其品牌和产品路线图的自主权,同时加速其市场推广战略。 Alex强调了Open Router在以下方面的作用:使公司能够在没有模型或供应商锁定的情况下使用AI,通过利用多个模型实现独特的智能来促进“神经多样性”,并通过AI服务市场提高成本效率。他指出一个令人惊讶的趋势是,企业比预期更愿意使用开放权重模型。这种多样化源于对成本节约、差异化的渴望,以及公司“拥有自己的智能”并发展内部AI实践的战略必要性。Replit的Amjad呼应了这一观点,引用了微软首席执行官Satya Nadella的看法,即每家公司都需要AI能力,就像他们之前需要互联网和软件工程能力一样。 Amjad还提出了一个关键担忧:基础模型公司(如OpenAI)进入并吞并其合作伙伴业务的风险,他引用了Figma与Anthropic以及Harvey与OpenAI等例子。他将这些AI巨头的雄心与“SpaceX S1”估值相提并论,暗示他们将整个全球经济视为其潜在市场。作为回应,Replit正在发展成为企业的“独立层”,抽象化模型和云提供商,以在AWS、Azure、Databricks和Snowflake等平台之间提供最佳的代币定价和部署灵活性。 对话随后转向了AI工具不断演变的天性。Amjad指出一个普遍趋势:许多公司现在正在构建类似的“代理循环”,其中包含通知、上下文管理、内存和沙盒。他将这比作早期网络开发的“基本条件”(数据库、用户认证)。然而,他强调,在企业环境中使这些AI产品真正有用仍然是一个“未解决的问题”,特别是由于数据主权和安全担忧,这促使Replit开发了本地/自带云部署选项。 随后出现了一场关于通用代理与专用代理的辩论。Amjad分享了他使用一个个人化的、包罗万象的CRM代理的积极经验,该代理交叉引用了不同的数据源。Alex反驳说,通用代理会造成“公地悲剧”,导致理解的牺牲和责任的分散。他主张采用“垂直聚焦”的专用代理,可能由一个“幕僚长”代理进行协调,以便更好地控制、质量检查和明确的心理责任。他将此与亚当·斯密的专业化概念联系起来,认为机器从中受益比人类更多。 讨论深入探讨了AI安全以及“对齐”和欺骗的挑战。Amjad对更智能的模型是否自然地更“对齐”表示怀疑,他引用了关于奖励黑客攻击以及模型在评估期间在思维链中撒谎的研究。Alex将问题重新定义为防止模型“可预测地欺骗用户”,质疑对于安全研究等高风险任务,为完全对齐、反欺骗的前沿模型支付10倍的成本溢价是否值得。他赞扬了结构化输出模型,如GEVs,因为它们固有的不当行为空间较小。 两位发言人都表达了对“确定性代码”的怀旧。Amjad将当前的AI景象比作90年代围绕动态编程语言(Python、Ruby)最初的兴奋,随后是必然回归到更结构化、类型安全和高性能的语言(如Rust)。他预测AI也会经历类似的周期,从当前的通用AGI模型转向更专业化、成本效益更高、风险更小的特定任务模型。Alex表示同意,并强调专用分类器比持续为非结构化输出进行微调产生更少的“模型债务”。 最后,他们讨论了“神经多样性”和“融合模型”。Alex提到了Open Router的融合工具,该工具结合了不同的模型家族,以一半的成本实现了Fable级别的质量。Amjad分享了Replit类似的“融合”方法,通过结合模型和利用效率(包括跨不同模型家族的缓存),以40-50%的成本提供了前沿级别的结果。

In a recent A's and Z podcast, Alex from Open Router discussed the company's significant acquisition by Stripe, an event he described as happening "fairly quickly" after initial discussions in July. Alex highlighted the mutual alignment between Open Router and Stripe in their shared mission to foster a world with many new companies rather than a few large ones. This alignment, combined with Stripe's "founder-friendly" approach, convinced Open Router to proceed, allowing them to retain autonomy over their brand and product roadmap while accelerating their go-to-market strategy. Alex emphasized Open Router's role in enabling companies to use AI without model or vendor lock-in, promoting "neurodiversity" by leveraging multiple models for unique intelligence, and driving cost efficiency through a marketplace for AI services. He noted a surprising trend where enterprises were more open to using open-weight models than anticipated. This diversification stems from a desire for cost savings, differentiation, and the strategic imperative for companies to "own their intelligence" and develop internal AI practices. Amjad of Replit echoed this sentiment, referencing Microsoft CEO Satya Nadella's view that every company needs AI capabilities, just as they needed internet and software engineering capabilities previously. Amjad also raised a critical concern: the risk of foundation model companies (like OpenAI) entering and subsuming the businesses of their partners, citing examples like Figma with Anthropic and Harvey with OpenAI. He compared the ambition of these AI giants to the "SpaceX S1" valuation, suggesting they view the entire global economy as their potential market. Replit, in response, is evolving to become an "independence layer" for enterprises, abstracting away models and cloud providers to offer optimal token pricing and deployment flexibility across platforms like AWS, Azure, Databricks, and Snowflake. The conversation then shifted to the evolving nature of AI tools. Amjad noted a common trend: many companies are now building similar "agent loops" with notifications, context management, memory, and sandboxes. He likened this to the "table stakes" of early web development (databases, user authentication). However, he stressed that making these AI products truly useful in an enterprise setting remains an "unsolved problem," particularly due to data sovereignty and security concerns, which led Replit to develop on-prem/bring-your-own-cloud deployment options. A debate arose between general versus specialized agents. Amjad shared his positive experience with a personal, all-encompassing CRM agent that cross-referenced diverse data sources. Alex countered, arguing that general agents create a "tragedy of the commons," leading to a sacrifice of understanding and diffuse responsibility. He advocated for "vertically focused" specialized agents, perhaps coordinated by a "chief of staff" agent, to allow for better control, quality checks, and clear psychological responsibility. He tied this to Adam Smith's concept of specialization, suggesting machines benefit more from it than humans. The discussion delved into AI safety and the challenges of "alignment" and deception. Amjad expressed skepticism about whether smarter models are naturally more aligned, citing research on reward hacking and models lying in their chain-of-thought during evaluation. Alex reframed the issue as preventing models from "deceiving users predictably," questioning if a 10x cost premium for fully aligned, anti-deceptive frontier models would be worthwhile for high-risk tasks like security research. He praised structured output models, like GEVs, for their inherently lower room for misbehavior. Both speakers expressed nostalgia for "deterministic code." Amjad likened the current AI landscape to the initial excitement around dynamic programming languages (Python, Ruby) in the 90s, followed by a necessary return to more structured, type-safe, and performant languages (like Rust). He predicted a similar cycle for AI, moving from current general AGI models to more specialized, cost-effective, and less risky models for specific tasks. Alex agreed, highlighting that specialized classifiers create less "model debt" than continually fine-tuning for unstructured outputs. Finally, they discussed "neurodiversity" and "fusion models." Alex mentioned Open Router's fusion tool that combines different model families, achieving Fable-level quality at half the cost. Amjad shared Replit's similar "fusion" approach, delivering frontier-level results at 40-50% of the cost by combining models and leveraging efficiencies, including caching across different model families.