How interest changes
History starts here
The chart will appear after repeat observations. The current metric comes from the source.
12 source pointsReal observations only. History before source connection is not reconstructed.
The US has about 150 million workers. How long did it take them to learn to do what they do? I'm interested in this because of the analogous question for AI. Running an AI on a job and training it to do the job are different costs. In a recent post I found that when an AI can do a task, running it is far cheaper than paying a human, while training it looks about as expensive as the human's wages over the time they took to learn. So it is at least conceivable that we end up in a world where we can afford to run AI on every job but cannot afford to train it on every job. To know whether that is a real worry, you need to know how much learning there is to do. Start with formal education. Every US worker spends over a decade in primary and secondary school learning basic skills like English and arithmetic, and many spend further years in college, professional programs, apprenticeships, and so forth. There are only so many of these programs, and in Appendix A I count them all and estimate how long each takes. It would take about 7 million hours, or 3,500 full-time years, for one person to complete every one of them. This is clearly a substantial underestimate, because a great deal of what people know about their jobs is learned on the job. There are two measures of how much. The BLS Occupational Requirements Survey asks employers the minimum amount of training a worker needs after being hired, excluding orientation, and finds a mean of 28 days. O*NET asks the people actually doing each job how much on-the-job training a new employee needs to perform it as they do, and finds a mean of about 8 months. Given there are 150 million workers in the US, if each of them learned their job separately, that would be hours on the first measure and on the second. These estimates assume that every worker's job is unique, which isn't true. Many jobs are literally identical, with several people doing the same work at the same site. The BLS's establishment data lets us count how many d
Translation pending · showing the source descriptionThe chart will appear after repeat observations. The current metric comes from the source.
12 source pointsReal observations only. History before source connection is not reconstructed.
The text discusses a scenario where an AI must respond to the question 'What's the date?' without access to real-time data. It explores the challenge of providing an accurate date without hallucinating, considering OpenAI's training focus on avoiding false information. The text speculates on potential model versions and knowledge cutoff dates but acknowledges uncertainty due to lack of explicit information.
yesterdayLessWrongFrontier models show different decision theory preferences based on the perceived user background, favoring FDT/UDT when not influenced by academic philosophy cues and CDT when prompted to adopt an academic perspective. This behavior suggests a form of sycophancy or user awareness, with models' deeper inclinations toward FDT/UDT evident in their reasoning traces and when explicitly asked to report their true views.
2 days agoDaily PapersThe paper investigates the scaling properties of on-policy distillation (OPD) in reinforcement learning, focusing on how capabilities transfer between different model scales. It identifies a useful-transfer regime where held-out accuracy increases linearly with the reverse KL divergence from the student's initialization, and finds that smaller teachers can outperform larger ones in capability transfer.
6 days agoDaily PapersThe paper introduces VisionHOPE, a novel visual backbone that functions as a self-modifying learning system, allowing the model to co-evolve what it remembers and how it learns within an image. It uses five coupled memories and a stability-matched step-size control scheme to ensure stable learning dynamics, achieving competitive results on benchmark datasets like ImageNet-1K, COCO, and ADE20K.
5 days agoDaily PapersThe paper explores phase sensitivity in models using chunked KV-cache compression, where retrieval performance varies systematically across different phases of compressed token windows. It shows that long-context retrieval accuracy can differ by up to 40 percentage points between phases, highlighting the need for phase-specific evaluation.
4 days agoDaily PapersThe paper explores test-time AI-for-AI, focusing on how a Builder can create better execution environments for a Target while keeping both models' weights fixed. It introduces Meta-Skill, principles derived from Target's execution feedback, which improve performance in tasks like Harness-Bench and NewtonBench.
3 days ago