AI is Building Our Data Pipelines Now (Estuary Live Demo)

发布时间    来源
Episode 设置




摘要

What if the most notoriously tedious parts of data engineering could be completely handed over to AI? In this live demo from Data Driven NYC, Estuary CEO David Yaffe discusses how they are using Claude to automatically generate, diagnose, and deploy complex, real-time data pipelines. Forget spending weeks wrestling with schema evolution, broken connectors, and manual ETL formatting—watch as David prompts an AI agent to instantly write a production-ready YAML specification that seamlessly connects Postgres, Snowflake, and BigQuery right before the audience's eyes. 03:07 – The "20% Problem" (Why manual data pipelines always break) 05:00 – Live Audience Demo: Moving live Postgres data to Snowflake in milliseconds 08:03 – Watch Claude write a complete pipeline YAML spec in seconds 09:52 – Why "Building Blocks" are the only way to survive the AI hype cycle Estuary Website - https://estuary.dev/ X/Twitter - https://x.com/Estuary HOSTED BY: FirstMark Capital Website - https://firstmark.com X/Twitter - https://twitter.com/FirstMarkCap Matt Turck (Managing Director) Blog - https://mattturck.com LinkedIn - https://www.linkedin.com/in/turck/ X/Twitter - https://twitter.com/mattturck This session was recorded live at a recent Data Driven NYC, our in-person, monthly event series. If you are ever in New York, you can join the upcoming events by following FirstMark on Luma: https://luma.com/firstmarkcap Check out the MAD Podcast: Spotify - https://open.spotify.com/show/7yLATDSaFvgJG80ACcRJtq Apple - https://podcasts.apple.com/us/podcast/the-mad-podcast-with-matt-turck/id1686238724

GPT-4正在为你翻译摘要中......

中英文字稿