Martian

Continued thoughts from Chris Mann as follow-ups to our recent article on automated prompt optimization (APO).

Claude Sonnet 3.5 Release: Token Prices and Jevons Paradox 🤔 With the release of Claude 3.5 Sonnet, there has been a lot of press about Moore's law and the recent LLM price decreases. We put this question to our Co-Founder and Co-CEO Shriyash Upadhyay (Yash). We wanted to share his perspective on this and his view for the future as it relates to token price and token consumption. We think you will enjoy what Yash had to say. We would love to hear your thoughts on this in the comments!? https://lnkd.in/eMyBjXip

At Martian, we are fortunate to work with many of the world's most advanced users of AI. We see the problems they face on the leading edge of AI and collaborate closely with them to overcome these challenges. In this first of a three-part series, we share a view into the future of prompt engineering we refer to as Automated Prompt Optimization (APO). In this article we summarize the challenges faced by leading AI companies including Mercor, G2, Copy.ai, Autobound, 6sense, Zelta AI, EDITED, Supernormal, and others. We identify key issues like model variability, drift, and “secret prompt handshakes”. We reveal innovative techniques used to address these challenges, including LLM observers, prompt co-pilots, and human-in-the-loop feedback systems to refine prompts. We invite the broader AI community to collaborate with us on research in this area. If you are interested in participating, please reach out to us! https://lnkd.in/eyvfEe2X #AI #ArtificialIntelligence #PromptEngineering #APO #MachineLearning #AIResearch #Collaboration #Innovation #ModelVariability #ModelDrift #LLM #FutureOfAI #AICommunity #HumanInTheLoop #AIChallenges #AIsolutions

🎉 𝐄𝐱𝐜𝐢𝐭𝐢𝐧𝐠 𝐁𝐫𝐞𝐚𝐤𝐭𝐡𝐫𝐨𝐮𝐠𝐡 𝐢𝐧 𝐀𝐈 𝐈𝐧𝐭𝐞𝐫𝐩𝐫𝐞𝐭𝐚𝐛𝐢𝐥𝐢𝐭𝐲! Last few weeks have seen a surge in AI Interpretability work: Anthropic researchers work on understanding Claude 3 models [Scaling Monosemanticity in AI](https://lnkd.in/eaYkgSNM) OpenAI released work on understanding GPT-4 [Extracting concepts from GPT-4] (https://lnkd.in/gFzijQwM) What's even more fascinating is their use of 𝘚𝘱𝘢𝘳𝘴𝘦 𝘈𝘶𝘵𝘰𝘌𝘯𝘤𝘰𝘥𝘦𝘳𝘴 (𝘚𝘈𝘌𝘴). Curious why SAEs are so effective and scalable? Our research at Martian provides some compelling insights: https://lnkd.in/gkvN2cXG At Martian, we leverage category theory—a mathematical approach focusing on relationships rather than object internals—to understand why SAEs perform so well. This theory underpins our broader efforts in "model mapping," a series of methods that promise enhanced interpretability without intensive manual analysis. 🔬 𝐌𝐨𝐝𝐞𝐥 𝐌𝐚𝐩𝐩𝐢𝐧𝐠: 𝐀 𝐂𝐨𝐦𝐩𝐮𝐭𝐚𝐭𝐢𝐨𝐧𝐚𝐥 𝐌𝐢𝐜𝐫𝐨𝐬𝐜𝐨𝐩𝐞 𝐟𝐨𝐫 𝐀𝐈 Our model mapping initiative acts like a microscope, revealing how AI models operate without dissecting their inner workings. This scalable approach benefits from increased computational power, paving the way for more efficient AI development. 🚀 𝐉𝐨𝐢𝐧 𝐌𝐚𝐫𝐭𝐢𝐚𝐧 𝐨𝐧 𝐎𝐮𝐫 𝐉𝐨𝐮𝐫𝐧𝐞𝐲! We're pushing the boundaries of AI interpretability and alignment. Learn more and get involved at [withmartian.com](https://withmartian.com).

We are excited to welcome a new Martian to the team! Chris Mann is joining us as Head of Product Marketing. Chris brings a wealth of product management and product marketing experience and has worked at LinkedIn, IBM, 1Password and a number of startups. Chris wrote a compelling article titled “Why I am Joining Martian” which tells a great story about his journey to find our company and how he thinks about our strategy which we have linked here. We think you may enjoy reading this: https://lnkd.in/gg3ZsfZp

OpenAI's top safety researchers quit last week. It's easy to say this is OpenAI's fault, but it's not -- it's incentives. Capitalism and safety aren’t aligned. And capitalism always wins. To make progress on safety, we need to align those incentives. Here’s how we do it 👇 Companies work on research which improves their core product. If you and your competitors both raise billions in a competitive space, but the other guy spends it on making better models, while you spend it on research about how models work, you lose. This is the fundamental cause of the disagreement between safety researchers and the leadership at companies who are developing AI. Incentives are why the problem has been systematic, as opposed to being a one-off phenomenon. Ilya Sutskever and Jan Leike are not the first safety researchers to leave top companies. @paulfchristiano and many of the folks @AnthropicAI did the same. The most important thing we can do for safety, then, is make products that improve the more we understand models. That way, the incentives are aligned.(This is actually why Martian’s mission is to “Make Better AI Tools By Understanding AI Better”.) What do such tools look like? One example is a model router: choosing what llm to use for what prompt. Routing is about predicting model performance without running the models first -- that way you send the request to the right model. To do this, you need to understand models. We’re sure many people will try to build routers. In fact, we’ve spoken to some who’ve tried and given up because it’s so hard. In order to make routers that are truly the best, you need to understand how these models work. That's what a strong incentive looks like. Our belief is that there are many such products waiting to be made. AI tooling could be far better than it is today -- with far more control over models, far more traceability in their internal operations, and far more applications as a result. At Martian, we're conducting research into how models work. But it can't just be a research project. It needs to be based around commercial applications of the technology. Read more here: https://lnkd.in/gXJB2tYt And if you want to work with us to understand AI, reach out: contact@withmartian.com

🌍 𝐓𝐡𝐞 𝐅𝐮𝐭𝐮𝐫𝐞 𝐨𝐟 𝐀𝐈: 𝐁𝐚𝐥𝐚𝐧𝐜𝐢𝐧𝐠 𝐏𝐞𝐫𝐟𝐨𝐫𝐦𝐚𝐧𝐜𝐞 𝐚𝐧𝐝 𝐒𝐮𝐬𝐭𝐚𝐢𝐧𝐚𝐛𝐢𝐥𝐢𝐭𝐲 GPT-4o, our latest frontier model, is now live on Martian platform for our users. It's faster, cheaper, and more efficient! Efficient models like GPT-4o are the need of the hour! At Davos 2024, Sam Altman highlighted a critical issue: the future energy demands of AI could overwhelm global systems. It’s not just about training models; millions of interactions with models like GPT-4 for inference also consume significant energy! 💡 At Martian, we're addressing this challenge head-on with our innovative Model Router. This tool is designed to significantly reduce both energy use and costs for AI inference and training—by up to 97%! Here’s how we do it: 𝐃𝐲𝐧𝐚𝐦𝐢𝐜 𝐌𝐨𝐝𝐞𝐥 𝐒𝐞𝐥𝐞𝐜𝐭𝐢𝐨𝐧: Our router directs each task to the most efficient model, often leveraging smaller models while maintaining high-quality outputs. By stopping computations at "good enough," we avoid the excessive energy costs of massive models. 𝐂𝐮𝐬𝐭𝐨𝐦𝐢𝐳𝐚𝐛𝐥𝐞 𝐏𝐞𝐫𝐟𝐨𝐫𝐦𝐚𝐧𝐜𝐞: Users can balance cost, energy use, and performance, selecting cheaper, faster models for quick tasks and powerful ones for critical outputs. Not just for inference, but improved model routing capabilities also optimize the model training process. 🤝 Major industry players are also uniting for a greener AI future. The Green Software Foundation (https://lnkd.in/deGYhAy), led by Accenture, Microsoft, and others, aims to reduce emissions by 45% by 2030. Optimizing both AI training and inference is key to this mission. 📖 𝐖𝐚𝐧𝐭 𝐭𝐨 𝐝𝐢𝐯𝐞 𝐝𝐞𝐞𝐩𝐞𝐫 𝐢𝐧𝐭𝐨 𝐦𝐚𝐤𝐢𝐧𝐠 𝐀𝐈 𝐠𝐫𝐞𝐞𝐧𝐞𝐫? Visit our Martian blog to see here: https://lnkd.in/g6bPQzRV Join us in building powerful, efficient, and responsible AI systems. The future is bright—and green! 🌱

Neural networks have revolutionized the world of AI, but their complexity often makes them opaque and difficult to understand. At Martian, we're tackling this challenge head-on by developing innovative methods to make black-box models transparent, editable, and verifiable. We call this approach "model mapping," and it's already powering over 1,000 businesses through our model router. Just like how biologists study an owl by examining its physiology (insides) and ecology (relationships), we're doing biology on AI. We're leveraging the power of category theory, a deep branch of mathematics that studies the world through the relationships between objects. By transferring knowledge from well-understood fields like programming to black boxes like neural networks, we're shedding light on the inner workings of AI. The impact of model mapping goes beyond just transparency. It enables us to: 1. Ensure AI alignment, making sure models do what we want 2. Optimize efficiency, making AI as fast and sustainable as possible 3. Enhance adaptability, allowing us to fix mistakes or add capabilities as needed 4. Improve accessibility, helping more people understand and trust AI At Martian, we're already using these techniques in our model router, delivering value to our customers by understanding models and matching the best AI to complete a given prompt. Our goal is to make understanding AI models more profitable than simply building new ones. Interested in learning more about how model mapping can make AI more transparent? Check out our full article (https://lnkd.in/gx7Ch3ep) and see how you can get involved or collaborate with us. We're excited to work together to advance the understanding of AI! 🚀 And if you're curious about the applications of this technology, visit withmartian.com to explore our model router and get in touch.

🎉 Martian was named one of the top 100 AI companies in the world by CB Insights! 🎉 It’s an honor to join the likes of OpenAI, Databricks, Perplexity, and others in 2024’s AI 100. In March 2023, we released the first commercial large language model (LLM) router and invented the category of model routing. It’s awesome to see not only how much Martian has grown, but how this category we conceived of is now part of the industry vernacular. Congrats to our friends Twelve Labs Elicit Glyphic Cognition Ema Unlimited Mistral AI Writer Together AI Voltron Data Modular Groq Extropic EvolutionIQ Pryon for making the list too! This list was chosen based on deal activity, industry partnerships, and team strength. View the full list of companies here https://lnkd.in/gJENamuX. and our press release at https://lnkd.in/guDHs4zG