The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch - 20VC: Are OpenAI and Anthropic Overvalued? The Open-Source AI Reality | How Token Costs Will Fall 10x And Usage Will Explode 100x | The Future Is Not One AGI; It's Millions of Specialised Models with Lin Qiao, Founder and CEO @ Fireworks
Lin Kuo, founder and CEO of Fireworks.ai, discussed his company's rapid growth and vision for the future of AI on 20VC. Fireworks.ai, which has scaled to $1 billion ARR in four years, operates in the inference layer, situated between chip providers like Nvidia and model developers. Kuo's central philosophy revolves around "specialized intelligence," fundamentally challenging a future dominated by a single, general Artificial General Intelligence (AGI).
Kuo argues that the vast majority of data, particularly private corporate data, remains untapped by current general intelligence models. He sees companies like OpenAI and Anthropic as building essential "power lines" or foundational infrastructure. However, he believes the true value and diversity lie in the "appliances"—specialized applications built on proprietary data and unique workflows. Echoing Nvidia's Jensen Huang, Kuo emphasized that "every company is built on a special belief," creating something unique that justifies its existence, thus necessitating specialized AI. He rejects the notion of a world "ruled by one standard" or taste dictated by a single company, highlighting human creativity and diversity.
Fireworks.ai's strategy heavily relies on open models, which Kuo champions for offering users full control, greater customization, and significantly lower costs. He points out the "scaling to bankruptcy" problem for many companies using expensive frontier models and predicts a "10x cost reduction in the next three years" for tokens, which will, in turn, drive "100x usage." This cost efficiency, combined with Fireworks.ai's unwavering focus on quality (ensuring "bit equivalence" between training and inference), is crucial for enterprise adoption. Open models, he notes, have zero acquisition cost for their weights, providing deep customization capabilities often superior to general models for specific problems.
Fireworks.ai currently processes over 40 trillion tokens daily, predominantly from customized models, and Kuo expects to at least double their current ARR by year-end. While acknowledging that current margins are lower than traditional SaaS, he attributes this to the company being in a "hyper-growth phase" where aggressive expansion and innovation take precedence over immediate margin optimization. He stresses the importance of agility and focus on Fireworks.ai's core strength, emphasizing leveraging partners rather than attempting to own the entire stack from chips to applications. While building data centers might be considered in the future, once the company reaches a certain scale (much like Meta did), chip development is viewed as premature given the dynamic nature of AI workloads.
Kuo identifies a significant current bottleneck as the lack of a "great system design for very large models" (e.g., 10 trillion parameters), requiring complex co-design across the entire AI stack. He also highlights the accelerating pace of hardware depreciation, where new models consistently prefer the newest hardware, complicating long-term hardware investment strategies.
Reflecting on his journey, Kuo, a 48-year-old founder, shared that he delayed entrepreneurship until he honed his understanding of "people." He recently hired George Hu, former Salesforce president, praising Hu's blend of experience and curiosity. Kuo believes the AI industry demands individuals with "contradictory characteristics" like deep experience coupled with high curiosity. His biggest lesson from Jensen Huang is the importance of deep, constant context for effective, fast-paced leadership. Looking ahead, Kuo firmly believes that within three years, "every single company will own their own intelligence as a must-have, not optional," drawing parallels to the current necessity of owning a software stack.