1 Comment

thank you so much for this,

Does vllm only works with CUDA ? If yes then it means we cannot use any hardware except NVIDIA ? 🥲

Cheers

Expand full comment