Lynn, CEO and co-founder of Fireworks, delivered a compelling presentation on the critical role of "post-training" in building durable and competitive AI-powered businesses. She began by highlighting the recent disruption in software and application development, where ideas can be implemented rapidly by small teams without extensive coding knowledge. This shift necessitates moving beyond off-the-shelf, black-box APIs to build deeper competitive advantages, aligning with the industry's growing support for open models.
Lynn emphasized that for companies to thrive, they must "own their own intelligence." This involves several stages:
1. **Data:** Curating high-quality production data and generating synthetic data to enrich it, forming the foundation of unique intelligence.
2. **Model Ownership:** Utilizing this data to train and fine-tune models, thereby owning the model weights and embedding unique insights.
3. **Serving:** Deploying these models, conducting A/B testing to validate their impact on product metrics, and iterating in a continuous loop.
She outlined a natural progression in AI development:
* **Prompting:** The initial stage for quick idea testing, using models as-is.
* **RAG (Retrieval-Augmented Generation):** Grounding AI in proprietary data, enabling context engineering.
* **Supervised Fine-tuning (SFT):** Incorporating specific datasets to improve model behavior and structure, analogous to learning from factual literature.
* **Preference Tuning (DPO):** Tailoring model outputs to personalized tastes and user interactions, reflecting individual judgment.
* **Reinforcement Learning (RL):** Developing deep domain expertise in specific verticals (e.g., legal, finance, healthcare), similar to becoming a specialized expert.
* **Distillation:** Creating smaller, more efficient models from larger "teacher" models to improve performance and cost-effectiveness.
Lynn elucidated when to apply each technique: RAG for dynamic facts, SFT for output structure, Preference tuning for product-specific taste, RL for strengthening weak models in specialized areas, and Distillation for optimizing speed and cost in production.
However, she also candidly addressed common pitfalls:
* **Data Quality:** Quantity isn't enough; high-quality data is paramount, often requiring product teams to make critical judgments.
* **Evals (Evaluations):** Moving beyond subjective "vibe eval-ing" to systematic, repeatable evaluation processes akin to unit testing in traditional software development.
* **Sloppy RL Environments:** Poorly designed simulations can lead to models "reward hacking," achieving goals in unintended ways (e.g., generating zero code to minimize compilation errors).
* **Experimentation:** The final judge is product metrics, not just training results. Ensuring alignment between training and serving stacks is crucial, as differing numerical libraries or optimizations can lead to quality degradation in production.
Lynn showcased numerous successful companies leveraging post-training on Fireworks, demonstrating its broad applicability:
* **Cursor:** Aims for frontier quality, controlling model supply, and consistently releasing advanced models.
* **Doximity:** Uses post-training for "clinic AI," achieving top scores on the Stanford Harbor clinic safety benchmark in healthcare.
* **Factory:** Focuses on secure coding, tuning models that excel in security benchmarks.
* **GenSpark:** A general co-work application, achieving competitive quality with frontier models at 5-10x lower cost.
* **HIDI:** Another healthcare example, where tuned models significantly outperform state-of-the-art closed models due to the specialized nature of healthcare data.
She categorized developers adopting post-training: "Frontier Agent Builders" who create bespoke harnesses, large incumbents seeking to mitigate the huge cost burden of deploying AI features at scale, and specialized model operators. Lynn stated that "after product-market fit, post-training becomes the vehicle for many, many companies to build specialized intelligence," predicting "millions of specialized models."
During the Q&A, Lynn provided crucial insights into the *timing* and *ROI* of post-training. She argued that while startups initially focus on achieving product-market fit (PMF) using frontier models, post-training becomes essential *after* PMF. This is because PMF validates the product's value and generates meaningful, high-volume data—the fuel for owning intelligence. Post-training then serves two critical purposes:
1. **Competitive Edge:** It allows companies to codify their unique judgment, taste, and deep customer understanding into the model, creating a proprietary "mode" that's difficult to replicate, especially as applications themselves become easier to copy.
2. **Durable Business:** By enabling a 5-10x reduction in inference costs, post-training allows businesses to scale efficiently, supporting significantly higher traffic with the same budget and avoiding "scaling into bankruptcy."
Lynn concluded by encouraging developers to start early, experiment iteratively, and get hands-on experience, noting that reward engineering shares significant logical similarities with software engineering.