List of Large Language Models on My Machines
The following are Language Models that I have been playing around with on my dev workstation.
| NAME | Size |
| codegemma:7b-instruct-fp16 | 17 GB |
| codellama:34b | 19 GB |
| codellama:34b-instruct | 19 GB |
| command-r:35b | 20 GB |
| command-r-plus:104b | 59 GB |
| dolphin-mixtral:8x7b-v2.7-fp16 | 93 GB |
| dolphin-mixtral:latest | 26 GB |
| llama2:13b | 17 GB |
| llama2-uncensored:70b-chat-q6_K | 7.4 GB |
| llama3:70b-instruct | 56 GB |
| llama3:8b-instruct-q8_0 | 39 GB |
| llama3:latest | 8.5 GB |
| llava:34b | 20 GB |
| llava:latest | 4.7 GB |
| phi3:3.8b-mini-instruct-4k-fp16 | 4.7 GB |
| wizard-math:13b | 7.6 GB |
| wizardlm2:8x22b | 79 GB |
The following are installed on the current AI server.
Filed under: Uncategorized - @ May 4, 2024 5:38 pm