Tell us about your rig running the model. Hardware and software stack. I saw that you're running vLLM?
Login to reply
Replies (1)
I heard something about a rig made from 3x RTX3090