On rare occasions they run a steam train to the museum. Fun, albeit useless, fact: it used to take the southern way around.
#trainstr
Sjors Provoost
sjors@sprovoost.nl
npub1v25j...exw3
https://github.com/sjors/
Book: https://www.btcwip.com
Podcast: https://bitcoinexplainedpodcast.com/@nado/episodes
250 pages into its adventure, Fable still believes it's living in a Cypherpunk adventure game internet simulation. Full of captchas, throwaway email services that PyPy blocked, looking for US number that Yahoo doesn't block. It even knows about BTCPay (from memory). Should it get some Bitcoin?
https://cdn.sanity.io/files/4zrzovbb/website/8359003bfb12a2f01ce84ad3df1d3a3e2f15a8eb.pdf


> The authoring agencies recommend U.S. AI companies take three immediate actions:
> 2. Deploy targeted response changes: Subtly alter responses for suspected malicious distillation attempts to attenuate the payoffs to companies conducting industrial-scale distillation campaigns.
In other words: poison competitor models, and potentially harm falsely flagged legitimate users (and get sued if they find out).
When reading, replace "China-based AI companies" with "US based competitors" and understand what that implies in a future where the big four can no longer undercut competitors with mountains of investor cash.
Cybersecurity and Infrastructure Security Agency CISA
China-Based Artificial Intelligence Companies Conducting Industrial-Scale Distillation Campaigns Against U.S. AI Companies | CISA
> Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage)
And who pays for that botnet's tokens? And then decides to just let it keep racking up bills?
> ... even when this gets us accused of hype, “doomerism”, or regulatory capture.
I wonder why...
> The first step is something Anthropic is unilaterally committing to (and calls on governments to require other frontier companies to match).
> The US and other democratic governments attempt to coordinate with authoritarian governments, to the extent this is possible [...]
Narrator: it's not.
We probably shouldn't have immature doomsday cult members in charge of very powerful technology, but that's where we are, and I'm still looking forward to cheap RAM when the bubble pops.


Dario Amodei — We Must Pace the Frontier
(worth translating)
View quoted note →
The title really undersells it, tl&dr:
- "thinking" text is useful for humans to analyze what a model is up to (I often find it more useful than the final burst of slop)
- this text is fed back through the model, which helps it with the next step (they give a nice example)
- but text is a lossy projection of the last tokens, what if you skip it?
- it's more efficient, great, but now you can't see what it's about to do until it does it
- ok, so force it to write "thoughts" e.g. once every 10 rounds
- turns out if you skip too many rounds, it can intentionally trick you with fake thoughts
I suspect there's actually a simple solution: convert these skipped rounds to text anyway, just don't feed them back into the model.
(via @m0wer)
#Rovolut
View quoted note →
View quoted note →I agree with Mark Karpelès. You heard it here first.
> The mentioned government agency has not been identified and other financial institutions or cryptocurrency exchanges could have been misled into disclosing their customer details through the same channel. I believe it is important for Revolut to urgently disclose information about the agency in question (most importantly, which was the email address used), or for the agency itself to come out about this case.
In addition there should be an investigation into criminal negligence in that government agency. But naming and shaming is a good start.
It doesn't absolve Revolut one inch of course. They committed the KYC and they leaked the data. Customer blood is on their hands.


X (formerly Twitter)
Mark Karpelès (@MagicalTux) on X
Revolut customers PII disclosed to an unauthorized third party