Foresight Institute

Very excited to attend the Longevity Biotech Fellowship and Foresight Institute workshop on bottlenecks to solve aging in a few weeks. And also to meet old and new friends at Stanford and FutureHouse. Mark Hamalainen Mariëlle van Kooten Anastasia Egorova Michael Florea Matthew "Oki" O'Connor Dr. Emil Kendziorra Jonathan Gootenberg Kevin Perrott PhD - Vitalist and many others. https://lnkd.in/g76GmncJ

Foresight AI grantee Harriet Farlow’s project, “Likelihood Analysis in AI Security,” addresses a critical gap in AI security research by quantifying the likelihood of AI incidents. While substantial research exists on the severity of AI security risks, the likelihood aspect remains underexplored. This project aims to draw from established risk assessment methodologies in cybersecurity, where risk is often defined as a function of severity and likelihood (risk = severity x likelihood). The project aims to provide a comprehensive understanding of the probability of exploiting AI vulnerabilities by developing a robust framework for evaluating and mitigating AI security risks. This will enable better-informed decisions and strategies to safeguard AI systems, contributing significantly to AI security. More about Foresight's AI safety grant here: https://lnkd.in/g-_uDbMp

Watch Richard Ngo, from OpenAI's Policy Frontiers team, explore different types of AI alignment goals at our recent Intelligent Cooperation workshop. Ngo categorizes them into single, single, multi-align, multi-single-align, and multi-align, each with unique considerations. He focuses on the goal of single alignment and the question of which aspects of a human’s goals or values the AI should be aligned with, noting a spectrum of options, from literal instructions to idealized values. The challenge for him lies in balancing obedience and paternalism. He proposes the concept of empowerment as a principled approach to this issue, where AI empowers users to make long-term choices and execute plans without incoherence or contradictory goals. He concludes that focusing on empowerment as a precise goal for a single alignment can help balance competing alignment objectives and avoid conflicts between user desires and AI nudges. See the full talk here: https://lnkd.in/dUynUWHT

Thank you to our grantees Joel Pyykkö and Roland Pihlakas, who developed a multi-agent benchmarking framework to explore safe multipolar AI scenarios! In their Aintelope project, Joel and Roland aimed to enhance AI safety in multipolar scenarios. They utilized multi-agent game simulations and game theory to develop a robust benchmarking framework for multi-agent systems. By experimenting with a biologically inspired reinforcement learning approach, they achieved significant improvements over existing industry standards in seven benchmarks. A detailed publication and a public repository of their benchmarks and methodologies are forthcoming. More about Foresight's AI safety grant here: https://lnkd.in/g-_uDbMp

Watch Anthony Aguirre discuss the future of compute governance at our recent Intelligent Cooperation workshop. Aguirre argues that controlling the limited supply chain for AI hardware is more feasible than attempting to control easily proliferated software. He proposes a two-part solution to compute governance: first, establishing governance contracts and regulations that nations can agree upon; and second, implementing a verification and enforcement layer using hardware and software cryptographic security measures to ensure governance is enforceable. See the full talk here: https://lnkd.in/dbdTuwA7

Foresight Institute's AI Safety Grant recently funded a workshop that invited leading researchers to explore formalizing the notion of boundaries in complex systems. This workshop was a large step toward extending the existing work on boundaries, establishing them as a significant new research subfield relevant to AI safety and complex systems theory. Thank you so much Chris Lakin for hosting and organizing this great workshop! Discover the retrospective report of the workshop here: https://lnkd.in/diGakJgm

Foresight Institute community is pretty cool! Inspiring, fulfilling and visionary. Nika held a lecture about Ani Biome’s approach to longevity through longitudinal digital diagnostics and personalized bioactives and exclusively announced our Community Shareholder Program. More about it in next few weeks. Nikolina showed some serious progress they’ve made in GlycanAge - going from cohorts to the individuals and from biological age to granular and precise prediction of diseases. Respect ✊ And much much more… Allison, congrats on the great event! #longevity #foresight #future #startup #personalizednutrition #ai #nanotechnology #mentalhealth

Happy to announce I will be joining the Vision Weekend Europe by Foresight Institute to present the Ani Biome personalised approach to mental health through the gut. I am excited to join the Path to Progress in Longevity track, and highlight the role of #nutrition, clinically validated #bioactives, and digital diagnostics as a continuous feedback loop to understand how we can impact our longevity - today. Grateful to have the opportunity to join the community of longevity experts, scientists, innovators and investors moving the needle towards a healthier and more sustainable future. #AI #personalisednutrition #longevity #guthealth #microbiome #gutbrain #gutbrainaxis #sustainability #health #healthtech #mentalhealth

I’m speaking at the Foresight Institute Vision Weekend 2024 on Mars governance, come by the Golden Room tomorrow!

Foresight Institute is a proud partner of The Longevity Prize. The Biomarkers of Aging Challenge has a $200,000 incentive. Discover more here: https://lnkd.in/dTnbWKj5