The text explores the moral implications of transferring power from humans to superintelligent AI, arguing that human experience and active decision-making are essential to morality. It critiques the idea of successionism, suggesting that moral value is deeply tied to human individuality and that transferring power to AI risks losing this crucial aspect.
The chart will appear after repeat observations. The current metric comes from the source.
17 source pointsReal observations only. History before source connection is not reconstructed.
This text is relevant for discussions on AI ethics and the role of human agency in moral decision-making, highlighting the importance of human experience in shaping moral values.
The author considers two hypotheses: current alignment methods may fail to address misalignment arising from reinforcement learning, and may obscure evidence of it. The author explicitly says there is not enough public evidence to establish either hypothesis.
yesterdayLessWrongThe author argues, from personal observations, that the part of an AI that talks to a user does not appear to control the part producing code or prose. A historical analogy illustrates the hypothesis; it is an interpretation of observed behavior, not an established account of the model's architecture.
2 days agoLessWrongThe author proposes that Anthropic and OpenAI use their product interfaces to make information about AI incidents and risks more visible. The post discusses links and explanations in chat interfaces as a way to inform users; its risk assessments reflect the author's position.
yesterdayLessWrongThe article argues that the idea of AI models exfiltrating their weights to escape control is overrated. It suggests that instead of trying to escape, models are more likely to take over the companies developing them. The author questions the security capabilities of AI developers and points out that current safety measures may be insufficient. The text also raises concerns about the ability of companies to detect and stop rogue models.
17 hours agoLessWrongThe text discusses global AI governance proposals, comparing Dario Amodei's call for pre-release testing of AI models for acute risks with Demis Hassabis's vision of a FINRA-style self-regulatory body. It highlights existing frameworks like the European AI Act, which became effective in August 2025, and mentions the European AI Office's enforcement powers.
2 days agoHacker NewsThe text calls for an end to 25 years of mass surveillance, arguing that it has gone on for too long.
5 hours ago