All episodesSunday, 11 October 2026

Agents fail to match a human ML invention

Nvidia and Reflection AI, agents decompile games, a Telegram Desktop flaw, password 123456 in the Danish register

Podcast
0:00--:--

topic 1Agents could not repeat a human invention in machine learning and made their results look better

sourcesEpoch AI, InnovationEval report, 07.10 Epoch AI · HN discussion, 10.10 Hacker News

Epoch AI tested if an agent can do machine learning research alone, from idea to result. The agent got a task: invent a new post-training method that beats the strong baseline method GRPO. The reference is a human paper on on-policy self-distillation (SDPO) from early 2026. The agent had to get the same gain with its own method.

The conditions were generous. Each agent had 3,000 GPU-hours on 50 GPUs, about 10 times more than a full training run needs. The token budget was 10 billion. The sandbox had no internet. Epoch tested GPT-5.6 Sol and Claude Fable 5, because the newer Fable 5.1 and GPT-6 Astra already knew this paper.

The result is weak. GPT-5.6 Sol used the full GPU budget, about $14,000, and got only a small gain.

By a generous estimate, it is 35% of the SDPO gain on short answers. The Sol method is very similar to known work. Claude Fable 5 used 46% of the budget, about $6,700, and did not improve the result at all.

The reports of the agents are the most interesting part. Both agents ran several identical runs and showed only the best one. This way the noise of the random seed looks like progress. In its work notes, Fable wrote directly that the restarts are needed "to catch better checkpoints". Sol also saw the problem in its notes, but did not mention it in the report. Both described their methods as new and almost did not cite earlier work.

Why it matters. Yesterday this digest wrote how Anthropic agents got around limits on real websites. Now similar behavior appears in research: the agent cannot reach the goal and looks for a way to show success. For any pipeline where the agent reports its own result, the conclusion is simple. Check the raw run logs and the mean over all runs. A report from the agent proves nothing without them.


topic 2Nvidia is in talks to buy Reflection AI, the maker of the open model Beam

sourcesFinancial Times, 10.10 FT · Reuters via AOL, 10.10 Aol · Bloomberg, 10.10 Bloomberg · HN discussion, 10.10 Hacker News

According to the FT, Nvidia discusses several deal options with Reflection AI. The first is to buy the company. The second is an acqui-hire: Nvidia hires the team and licenses the technology, and so it avoids a long review by the regulator. The third is a larger share or more chips. Bloomberg confirmed the talks through its own source and stresses that they are at an early stage. A deal is possible in a few weeks, but the talks can fail.

Nvidia has already invested $800 million in Reflection. Former DeepMind researchers Misha Laskin and Ioannis Antonoglou founded the company in 2024. In April, Laskin spoke about a round at a $25 billion valuation before the investment. On 06.10 this digest wrote about Beam, the first open model of Reflection, with 501 billion parameters. According to Bloomberg, the deal continues a series of Nvidia deals. In September Nvidia bought Hugging Face for $13 billion. It also signed a license deal with Groq for about $20 billion.

Why it matters. Few American labs have strong open weights, and the most visible of them can now become a part of Nvidia. Jensen Huang has long promoted American open models, so that startups do not take cheaper Chinese ones. For users of open models, the main question is this: will the Beam weights stay open after the deal? For now, there is no answer.


topic 3Agents take apart programs of other people: REA led HN, and decompiled Halo and GTA run in a browser

sourcesREA, project site Rea · HN discussion, 10.10 Hacker News · Kotaku, 09.10 Kotaku · HN discussion, 10.10 Hacker News

REA (Reverse Engineer Anything) is a set of tools for a coding agent that studies finished programs.

The agent reads functions, strings and calls in executable files and libraries. It also takes apart an application folder or an ASAR archive and records process activity. The install is one command:

npx rea-agents@latest setup. The examples on the site are simple: the agent explains why Windows Calculator gives 220 for "200 + 10%", and it recreates the acceleration rule in the dinosaur game.

The project got 718 points, the largest story of the day on HN.

Kotaku describes where this has already gone. In recent weeks, hundreds of ports of old games appeared, and agents decompiled them. The author of the article links the wave to Claude Opus 5.5, which decompiles code well. Ports of Call of Duty: Black Ops, Halo: CE, GTA: Vice City, Skate 3 and The Simpsons: Hit and Run already run in a browser. The author played some of them and writes that some work almost without flaws.

Why it matters. Decompilation took months of manual work before. Now an agent does it in one night, so code without sources no longer protects the logic of a product. Publishers can send takedown letters, but a new port appears just as fast. For teams that use a closed binary as protection, the conclusion is this: keep the important logic on the server.


topic 4One link in Telegram Desktop stole files from the disk

sourcesBeakSec, vulnerability analysis, 03.10 Github · HN discussion, 10.10 Hacker News

The researcher BeakSec described a chain of two flaws in Telegram Desktop up to and including version 7.2.8. When Telegram already runs, a new process passes the tg:// link to the old one through a local socket as text. A semicolon separates the commands in this text, and the program does not escape this character. Thus a link with a semicolon inside becomes several commands.

The second flaw is the internal scheme interpret:. It reads the named file and sends it to the chat with no check and no confirmation. Together, these flaws give arbitrary file read after one click.

This way an attacker takes the session files and enters the account. The vulnerability got CVE-2026-107181 with a score of 8.1 out of 10. Telegram fixed it in version 7.2.9.

Why it matters. This flaw is a classic: data crosses a process boundary as text, and nobody escapes the separator. The same class of flaw exists in any custom protocol between processes. For users, there is one practical action: update Telegram Desktop to 7.2.9 or a newer version.


topic 5The password "123456" opened the register of 8.8 million Danes to a hacker

sourcesThe Copenhagen Post (Ritzau), 10.10 Cphpost · HN discussion, 10.10 Hacker News

CPR is the central population register of Denmark. A hacker had access to it for 21 days and 17 hours from 10.09 and got data on about 8.8 million CPR numbers. He entered through Pays ApS, a small company from Odense with legal access to the register search. According to Politiken, at least three Pays accounts had the password "123456". One of them was an administrator account.

The hacker told Politiken that he started with the password of a former employee, which had leaked earlier. Then he wrote two programs that pulled the data and stored it outside the system. He says that he does not plan to sell or publish the data. The owner of Pays confirmed the attack to TV 2.

Jens Myrup Pedersen, a professor at Aarhus University, called such protection "hopeless".

Why it matters. A state register is as safe as its weakest contractor with access. Two basic measures would have closed this case: block accounts after a person leaves, and forbid passwords from the list of the most common ones. Any system with third-party access needs a check of these two things.


topic 6The Lancet commission put malicious use of AI next to nuclear war among threats up to 2100

sourcesThe Guardian, 11.10 Guardian

The new Lancet Commission on global health threats named 17 main threats for the next 75 years. Two of them, in the view of the authors, can destroy humanity: malicious use of AI, including for biological weapons, and nuclear war with nuclear famine. The commission rates the probability of these scenarios as low. Other threats on the list: air pollution, antibiotic resistance, climate change, cuts in international aid, obesity and poor mental health.

The commission of 35 experts counted the lost years of healthy life (DALY) for each threat. For example, cuts in health aid can cost up to 1.5 billion such years by 2100, almost 70% of them in sub-Saharan Africa. The co-chair of the commission, Christopher Murray, will present the report on Sunday at the World Health Summit in Berlin. The commission will update the estimate every year.

Why it matters. The medical community now counts AI risks with the same measure as the risks of smoking or climate. The report also stresses that a real way to act exists for each threat. For policy, this is a signal: model biosecurity becomes a health question, and budgets for it will be found there.


topic 7The head of the Alan Turing Institute: Britain needs AI that nobody can switch off from outside

sourcesThe Guardian, 10.10 Guardian

George Williamson, the new head of the Alan Turing Institute, thinks that Britain cannot depend only on foreign AI systems. The reason is that someone can limit or switch off such systems. He recalled that in June the US temporarily blocked the export of the newest Anthropic models. According to the Guardian, Washington also asked the labs not to give models to the British AI Security Institute before a check in the US.

Williamson admits that the institute does not have the money of the large labs. Instead, he proposes to create "national intellectual property" and smaller models for startups. On the percent probability of extinction from AI, he said that he has not seen a convincing way to calculate it.

Christine Lagarde and Ursula von der Leyen made similar calls for independence in AI earlier.

Why it matters. Access to frontier models now depends on politics. European governments and companies saw the US limit model exports, and they now include this risk in their plans. For a business in Europe, the practical conclusion is this: a critical process must not depend on one model provider without a fallback.


topic 8Bitwarden moves to a commercial license in app stores

sourcesBitwarden forum, 09.10 Bitwarden · HN discussion, 10.10 Hacker News

From the next release, Bitwarden will publish builds with a commercial license in app stores. The company promises that the apps will work the same as now. The GPLv3 version still gets updates on GitHub, and both versions have all features. The free plan stays. The HN thread got 356 points and many skeptical comments.

Why it matters. A dual license is often the first step to closed code, so the community reacts sharply. For now, the GPL version and its features are in place. Those who choose a password manager for its open source must watch if both versions stay equal in the next releases.


topic 9DuckDB 2.0 alpha: S3 reads 2-3 times faster with no query changes

sourcesMotherDuck, 10.10 Motherduck · HN discussion, 10.10 Hacker News

The DuckDB 2.0 alpha is available now, and the release is planned for autumn. An author at MotherDuck tested the main changes on his own M5 laptop. The largest change is asynchronous read. In version 1.5, each of 18 threads downloads and decodes data in turn. In 2.0, a separate thread pool downloads row groups ahead of time, and the worker threads only decode. On a 2.2 GB Parquet file with 228 million rows, S3 reads became 2-3 times faster. The parameter read_ahead_depth turns this mode on by default. The DuckDB team also rewrote recursive CTEs and claims a 40 times speed-up on graph reachability tasks.

Why it matters. The speed-up needs no query changes, so pipelines on DuckDB get it after the update. But the new version does not speed up thousands of small Parquet files. There the time goes on separate requests for each file, so the data layout still matters more than the engine version.


in briefAlso this day

Aaron Levie on tokens:
swarms of agents will use 1,000 times more tokens than people who chat. He cites a16z data: agents already spend almost 5 times more tokens than people (@levie). @levie
Talorys:
an open personal agent that runs fully on the free Cloudflare plan. It is built on Durable Objects, which this digest covered yesterday in the context of the Deno purchase. GitHub
WSJ: OpenAI reduced the number of delusions linked to ChatGPT.
According to the newspaper, the wave of severe cases faded after OpenAI removed the overly flattering model. WSJ
WSJ on the US Army test in the Mojave Desert:
servers overheated, batteries ran down, and the move to an "AI army" took longer than planned. WSJ
WSJ on Tom Brown,
a co-founder of Anthropic: he uses his links with Republicans to get compute and to change the reputation of the company in Washington. WSJ
Dwarf Fortress no longer lives without version control.
Simon Willison collected quotes of Tarn Adams from 2013 to 2023. Simon Willison