arXiv.org
LLMs Get Lost In Multi-Turn Conversation
Large Language Models (LLMs) are conversational interfaces. As such, LLMs have the potential to assist their users not only when they can fully spe...
npub1uqee...jckg
npub1uqee...jckg
Microsoft wrote a paper about how much LLMs degrade in multi-turn convos. I’m glad my hunch was finally confirmed. I’ve felt for a while that resetting the context and tweaking the first prompt is often far more effective than clarifying with a follow up prompt when the LLM misunderstands or fails to solve the problem on the first attempt.
My guess was that there just aren’t enough examples of multi turn convos in the RLHF training dataset, especially of LLMs recovering from a mistake, but I hadn’t considered how benchmarks play into it. Because the format of most benchmarks is just “question->answer” without any follow ups your LLM can test well and still fall apart the moment the user asks a second question.
To the surprise of literally no one, once you start randomly imposing tariffs on everyone you get really unpopular.
US popularity collapses worldwide in wake of Trump’s return – POLITICO
Google’s latest version of Gemini 2.5 Pro is freakily smart.
I was going to send an email pointing out where I thought someone was incorrect about the ability of moral facts to affect our brains backed up with research. I fed the email through Gemini 2.5 Pro to review it and after several back and forths became convinced that I was actually incorrect and completely misunderstanding the core of the argument.
Reason Magazine
Seemingly Nonexistent Citation in Anthropic Expert's Declaration [UPDATE: Apparently Caused by Lawyer's Misuse of Claude to Format Citations]
The Declaration filed by a "Data Scientist at Anthropic" in Concord Music Group, Inc. v. Anthropic PBC includes this citation:…
Random thought, why do we have a sex offender registry for only sex related crimes? I suppose I would want to know if I guy who molested kids moved in next door but I would also want to know if a guy who broke into multiple homes moved in next door. I don’t see what distinguishes sex related crimes from other crimes that warrants only sex crimes getting a registry.
We should pick a standard and apply it equally, either every criminal goes on a public registry or no one does.
smolagents/computer-agent · Why do many prompt words always lead to pornographic web pages
I enter something like "find me some music videos on youtube", step 1 shows pornhub. enter "I just want a ball bouncing inside the screen", it stil...
https://www.nih.gov/about-nih/who-we-are/nih-director/statements/nih-lifts-funding-pause-gain-function-research
Trump recently re-instituted the ban on gain of function research which was previously lifted by none other than… Trump.
One global pandemic later and he appears to have learned why we had that ban in the first place.
So after everyone (rightfully) freaking out about Kamala Harris imposing price controls on drugs now Trump has done the exact same thing and instituted drug price controls?
I’m giving up. Nothing in the timeline we’ve fallen into makes sense anymore.
Marginal REVOLUTION
Supply is elastic, installment #6437 - Marginal REVOLUTION
Numerous empirical studies show a relationship between a drug’s expected market size and the magnitude of research and development investments. E...
Similarweb
Top Websites Ranking - Most Visited Websites In The World | Similarweb
Top websites ranking: See the full list of most visited websites in every category and country in the world for free - Click here
Burrito Now, Pay Later
Liquid Lunches And The Serious Case for BNPL Securitization
https://www.home.cern/news/news/physics/alice-detects-conversion-lead-gold-lhc
Looks like we owe all the alchemists a big apology. We can actually turn lead into gold. Unfortunately the economics are wildly infeasible, but it’s still fun we can do it.
ChatGPT taking every opportunity to trip over itself complimenting how right and intelligent you are does have its upsides. Model refusal rates seem to be significantly lower.
micahflee
Despite misleading marketing, Israeli company TeleMessage, used by Trump officials, can access plaintext chat logs
💡Update May 18, 2025: I described TeleMessage's trivial vulnerability in an article for WIRED: How the knock-off Signal app used by Trump offici...
I’m sitting next to an old man in a wheelchair who’s spent the last half hour watching the most mindless TikTok slop with the volume at full blast.
There are so many things I don’t understand. I would be embarrassed to play anything out loud on my phone in a public place and would be mortified if it was brain rot. Apparently he just doesn’t care.
Nuclear weapon detonation in 2025?
Nuclear weapon detonation in 2025? (Resolved): View final results and past odds on The World’s Largest Prediction Market™
Reason Magazine
Kanye West "Is Not Merely a Creator; He Is Art" (Say His Lawyers)
A perhaps somewhat over-the-top argument in a motion to dismiss an employment lawsuit (Doe v. Yeezy, LLC). The motion itself...
https://www.wsj.com/world/china/china-economy-data-missing-096cac9a
China might be in trouble. There’s no way they would hide their economic data if it painted a rosy picture of the Chinese economy.
I used an LLM to brainstorm some deviously persuasive rhetorical tactics for an email and was pleased until I realized that they'll probably be used on me soon.
The average human is not ready for intelligence equivalent to a top performing human to be unleashed on them to tailor every message and request to their precise idiosyncrasies.
https://www.nih.gov/about-nih/who-we-are/nih-director/statements/accelerating-access-research-results-new-implementation-date-2024-nih-public-access-policy
Finally just some solid policy decisions. This should have been done a long time ago. The next big step should be enforcing data uploads in common formats that has to be hosted alongside the paper to make everything transparent and reproducible.
Welcome to The Future
This time it arrived right on schedule.