> You can run hw attested end to end encrypted inference in cloud.
That's ... not really an option for sensitive data. It's very naive to trust the promise of those providers. Yeah, you can maybe get a secure channel to their TEE but TEEs in some far away data center can be compromised without you having any chance to ever learn about. TEE providers are notoriously secretive about their vulnerabilities and rely a lot on security by obscurity. And reading out that RAM was done before.
Login to reply
Replies (1)
Very doubtful they would be doing that for reading your prompts. Again, game theory. You would be doing that for a crypto bridge to steal private keys.