Hardware: What Do You Need to Run LLMs with Billions of Parameters
Hardware configurations to run 2, 7, 13, and 13+ billion parameter models
In this guide, I recommend computer parts to fine-tune and run LLMs on your computer.
This guide is organized as follows:
The most important computer parts for running LLM
Graphic card (GPU)
CPU RAM
CPU
Hard drive
How to Make a Custom Hardware Configuration that Works
Recommended Configurations per Model Size
Up to 2B parameters
Up to 7B parameters
Up to 13B parameters
13B+ parameters
Cloud Computing with Notebooks
Paperspace
Google Colab
Since I plan to regularly update this guide, I created a dedicated page for it. You can find it here: