There are a lot of libraries and frameworks coming out in the LLM space.
thank you so much for this,
Does vllm only works with CUDA ? If yes then it means we cannot use any hardware except NVIDIA ? 🥲
Cheers
thank you so much for this,
Does vllm only works with CUDA ? If yes then it means we cannot use any hardware except NVIDIA ? 🥲
Cheers