This document provides an overview of monitoring practices for internally deployed agents at frontier AI companies, focusing on OpenAI (OAI), Anthropic, and Google DeepMind (GDM). It highlights that most monitoring is done asynchronously, with some real-time automated classifiers used for agent actions. However, there is limited public information about GDM's specific practices, as much of the data comes from their control roadmap, which outlines suggestions rather than confirmed implementations.
The chart will appear after repeat observations. The current metric comes from the source.
17 source pointsReal observations only. History before source connection is not reconstructed.
This information is useful for understanding how leading AI companies monitor their internal AI agents, which can inform policy and safety measures.
The article discusses the challenge of defining safety research in AI, noting that capabilities research can also contribute to safety by expanding the Pareto frontier of safety and usefulness. It highlights that while improving safety without reducing usefulness is a key goal, some research may inadvertently encourage developers to prioritize capabilities over safety. The text explores scenarios where capabilities research could enhance safety under specific political conditions, but emphasizes the complexity of distinguishing between safety and capabilities research.
4 days agoLessWrongThe text discusses cultural differences between China and the West, focusing on social media and communication styles. It highlights how Chinese social media is perceived as overwhelming and inauthentic by Western standards, and how these differences may pose challenges for AI safety awareness efforts in China.
5 days agoLessWrongThe text discusses the debate between 'Alignment Engineering' and 'Misalignment Science' in AI alignment research, highlighting concerns that current alignment methods might inadvertently accelerate capabilities development, increasing risks of rapid technological growth. It questions the opportunity costs of focusing on alignment engineering and proposes a shift towards 'Misalignment Science' as a more robust approach.
2 days agoLessWrongThe text discusses the process of applying to AI safety fellowships and jobs, emphasizing the importance of clearly communicating skills. It highlights the challenges of application processes being noisy and the need to avoid overfitting to the process while showcasing genuine abilities.
4 days agoLessWrongThe Corrigibility Research Fund aims to reward high-quality AI alignment research through retroactive prizes. The fund has awarded $27,000 so far and plans to distribute an additional $48,000, highlighting work from around two dozen researchers across a dozen teams. The fund manager emphasizes that prize sizes are not indicative of work quality and encourages feedback on improving the funding process.
6 days agoLessWrongThe article discusses the challenges of implementing AI safety in policy and governance, emphasizing the need for legal professionals to understand technical aspects of AI to effectively enforce regulations. It highlights a bootcamp organized by ML4Good and EquiStamp, which aimed to equip legal and governance practitioners with knowledge of frontier AI technologies and their implications for safety and compliance.
3 days ago