Replies (14)

HoloKat's avatar
HoloKat 10 months ago
Oh I’m thinking for content discovery - you’d need to pull all events from multiple relays and probably the reaction counts - that would kill data I think. And battery
HoloKat's avatar
HoloKat 10 months ago
Suppose you could pull only new events and already have a local cache of seen stuff
Even just to “discover” content in your own existing feed (like stuff that happened whilst you were asleep but missed) would be cool. For content suggestion for people you don’t even follow would need more consideration.
I would recommend relays to dump to parquet files on cloudflare R2 with 0 egress charges and clients use DuckDB to query.
HoloKat's avatar
HoloKat 10 months ago
Doesn’t this introduce centralization that we seek to avoid in the first place?
Makes sense. But what about parquet on ipfs or arweave? I don't think DuckDB integrates with them though! 🤔