The paper discusses the challenge of ensuring AI systems maintain stable values aligned with human existence, especially in dynamic and unpredictable environments. It highlights the difficulty of developing AI that consistently adheres to its own values over time and across different scenarios.
The chart will appear after repeat observations. The current metric comes from the source.
7 source pointsReal observations only. History before source connection is not reconstructed.
This research emphasizes the critical need for AI systems to maintain consistent values to avoid harmful outcomes, particularly in complex and evolving environments.
The author proposes that Anthropic and OpenAI use their product interfaces to make information about AI incidents and risks more visible. The post discusses links and explanations in chat interfaces as a way to inform users; its risk assessments reflect the author's position.
3 days agoLessWrongThe author considers two hypotheses: current alignment methods may fail to address misalignment arising from reinforcement learning, and may obscure evidence of it. The author explicitly says there is not enough public evidence to establish either hypothesis.
3 days agoLessWrongThe author argues, from personal observations, that the part of an AI that talks to a user does not appear to control the part producing code or prose. A historical analogy illustrates the hypothesis; it is an interpretation of observed behavior, not an established account of the model's architecture.
4 days agoLessWrongThe text provides quick tips for technical professionals to improve their public speaking, focusing on oral communication and practical advice for interviews about AI safety and superintelligence. It emphasizes deliberate practice, structured delivery, and awareness of social context.
yesterdayLessWrongThe text discusses the limitations of METR as an independent oversight body for Anthropic, arguing that METR lacks true independence, sufficient staffing, and authority to effectively check Anthropic's safety practices. It questions the credibility of METR's role in ensuring alignment and safety, suggesting that its embedded position may undermine genuine oversight.
yesterdayHacker NewsThe text calls for an end to 25 years of mass surveillance, arguing that it has gone on for too long.
2 days ago