You can only use the signer for onchain zaps

That's the missing part. If Cashu.me introduced Amber offline mode, it would be sweet.