The Kaitchup – AI on a Budget
Subscribe
Sign in
Share this discussion
Run Llama 2 70B on Your GPU with ExLlamaV2
newsletter.kaitchup.com
Copy link
Facebook
Email
Note
Other
Run Llama 2 70B on Your GPU with ExLlamaV2
Benjamin Marie
Sep 27, 2023
5
Share this post
Run Llama 2 70B on Your GPU with ExLlamaV2
newsletter.kaitchup.com
Copy link
Facebook
Email
Note
Other
Finding the optimal mixed-precision quantization for your hardware
Read →
Comments
Share
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
Run Llama 2 70B on Your GPU with ExLlamaV2
Run Llama 2 70B on Your GPU with ExLlamaV2
Run Llama 2 70B on Your GPU with ExLlamaV2
Finding the optimal mixed-precision quantization for your hardware