Awesome chat with Nicolay Christopher Gerold about orchestration tools.
Building AI and Data Systems | Working where unstructured data and AI intersect | Using data engineering in AI and AI in data engineering Aisbach CEO | Host of How AI Is Built
AI success starts with smooth data flow. In today’s episode of How AI Is Built, I chatted with John Wessel, founder of Agreeable Data and co-host of The Data Stack Show, to demystify data orchestration. We break down how to streamline AI pipelines, the best tools for the job (Apache Airflow, Dagster, and more!), and when you actually need a full-blown orchestrator. If you're working with AI or complex data projects, this episode will help you get your data flowing smoothly and boost your model's performance. Key insights: - Keep it simple: Sometimes, basic tools get the job done. Prioritize solving the AI problem over complex tech. - Developer experience is key: Choose solutions that empower your team, not hold them back. - Solve the use-case first: Start with the use-case, solve it, and then think about the right orchestration tool. Link to the episode is in the comments below. Stay tuned for next week's episode about data architectures and choosing OSS tools with Jon Erik K.. #dataorchestration #AI #machinelearning #dataengineering
