vLLM models

vLLM supports a wide range of models, including:

• LLaMA
• Mistral
• GPT-2
• GPT-3
• GPT-4
• GPT-4o

code.txt
1# Mixtral
2--model mistralai/Mixtral-8x7B-Instruct-v0.1
3
4# OpenHermes
5--model teknium/OpenHermes-2.5-Mistral-7B
6
7# LLaMA 3
8--model meta-llama/Meta-Llama-3-8B-Instruct
9
10# Phi-3
11--model microsoft/phi-2