Max's avatar
Max max@nostr.com 6 months ago
I'm insanely bullish on confidential compute and @Maple AI / @OpenSecret AI will provide a tremendous amount of value for the world. But it will also allow for mind manipulation on steroids that makes what happened with web 2.0 cos like Facebook look tame. But there's now an alternative to the closed source mega models and hosting - OpenSecret / MapleAI effectively offer developers a publicly accessible (and open source) version of Apple's encrypted inference cloud:
Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple Security Research
Private Cloud Compute: A new frontier for AI privacy in the cloud - Apple Security Research
Secure and private AI processing in the cloud poses a formidable new challenge. To support advanced features of Apple Intelligence with larger foun...
 Thank god for cryptography, the work of people like Anthony / @Marks, and organizations like Apple View quoted note →
↑ Parent

Replies (3)

Azz's avatar
Azz azza@nostrplebs.com 6 months ago
Maybe this? I don't know how you can be sure your data remains confidential. Surely it needs to be decrypted for the model to read and process it, which if that's not done locally how can you ensure it's not intercepted. Being able to access it anonymously is good, but then you can't train it with your specific information and it would be hard not to identify yourself in the prompts. I need to look into this more. View quoted note →
1 replies ↓
Honza Pobořil's avatar
Honza Pobořil honza@poboril.cz 6 months ago
I am sceptical, my bullshit detector beeps. Secure enclaves are useful in local devices what anyone can audit. Even proprietary iPhones are audited by the great independent hackers what love to get a proof Apple lied. But how you can be sure that AWS instance actually run some hardware what can guarantee something? How you know you are not talking with emulation of that crypto element? How independent hacker can do his research without operator knowing?
↑