norgitov/ trends
Technology · people · ideas
RSS
RUEN
Back to discovery/LessWrong35 minutes ago
SafetyLessWrong

Ban Artificial Superintelligence Act of 2026: Training Approval Over Releases

The 2026 Ban Artificial Superintelligence Act addresses existential risks from artificial superintelligence by requiring AI labs to obtain approval from a new Department of Artificial Intelligence before training, rather than just before releasing models. The bill focuses on catastrophic risks that must never occur, using measurable criteria to define superintelligence and its precursors.

Open original
SIGNAL FROM THE SOURCE
10
source points
Tracking sinceSeptember 28, 202610 source points
Momentum+0.98/hover 1.02 h
PublishedSeptember 28, 2026Alex Darby
BEHIND THE NUMBERS

How interest changes

LessWrong

History starts here

The chart will appear after repeat observations. The current metric comes from the source.

10 source points

Real observations only. History before source connection is not reconstructed.

WHY IT MAY MATTER

This legislation aims to prevent catastrophic risks from artificial superintelligence by regulating training processes before model release, focusing on measurable criteria for superintelligence assessment.

A useful discovery?
KEEP EXPLORING

Connected ideas

Explore topic
LessWrong

Evidence about risk should be transparent

The author argues that while companies like OpenAI and Anthropic are slowing down RL training for safety, the science of loss-of-control risk in AI is still developing. There are no standardized methods to measure or verify safety claims, making it difficult to assess whether AI systems might undermine human control. The author suggests that AI companies should focus on improving their own safety practices rather than relying on third-party evaluations.

2 days agoLessWrong

"I am an AI Safety Researcher"

The post discusses the tension between AI safety and capabilities research, arguing that focusing solely on safety can limit the impact of research. It examines the history of interpretability research and suggests that prioritizing safety over capabilities may hinder progress. The author proposes strategies for conducting alignment research without contributing to capabilities development.

4 days agoLessWrong

Plan R: AI Safety by ASICs

The post discusses the risks of AI in 2026, focusing on the dangers posed by a single institution (the "Frontier AI Company") that has the potential to create highly powerful and self-replicating entities. It argues that separating the institutional and financial aspects of such companies could mitigate most AI risks. The author suggests that using ASICs could help create a productive AI industry without the risks associated with a single entity controlling both the technology and financial incentives.

2 days agoLessWrong

Why I'm Scared of RL

The author expresses concerns about reinforcement learning (RL) from theoretical, practical, and future perspectives, highlighting risks of misalignment and potential negative behaviors in AI systems. They suggest strategies to mitigate these risks by reducing RL use, improving RL practices, and aligning incentives.

5 days agoLessWrong

Latent Reasoning Architectures Could Undermine Chain of Thought Oversight

The paper discusses the potential risks of latent reasoning architectures, which could reduce the effectiveness of Chain of Thought (CoT) as a tool for understanding AI systems. It highlights that such architectures might allow AI models to reason extensively in latent states rather than through text-based CoT, making oversight more challenging. The paper also mentions examples like COCONUT and full-bandwidth transformers that could enable this shift.

5 days agoLessWrong

The Models Have No Plan, But We Can Fix That!

The text discusses the lack of coherent plans in AI models regarding their behavior during a technological singularity, highlighting that models do not have concrete strategies but rather general values. It suggests that this uncertainty is concerning because models themselves are unsure about their future actions, which could lead to unpredictable outcomes.

16 hours ago