Replies (2)

Get a blackwell Max-Q 96 gb vram. Its on the edge of what you can run on retail electricity if you get 2 you will be able to run any model in the world. You'll probably be good for lifetime in terms of AI models because they're hitting scaling laws on larger VRAM and are actually decreasing in size, but the VRAM would still be good for ultra large contexts.