The slow loading is expected, it’s also slow when group mode is off. I’m not sure what cache issues there might be. It’s just that some Nostr clients I’ve used before had problems that seemed related to caching, like failing to load new events.