Maybe the set of users that I fully trust could be a secret. i.e. This set is stored in a relay, but encrypted such that only I can decrypt the result to see the npubs which I really trust