The Kaitchup – AI on a Budget

Home
Notes
AI Notebooks
The Kaitchup Pro
Table of Contents
The Kaitchup's Book
Tutorials
Models
Archive
About
The Weekly Kaitchup #59
Qwen2.5 - Ternary LLMs - Moshi
 • 
Benjamin Marie
Run and Serve Faster VLMs Like Pixtral and Phi-3.5 Vision with vLLM
Understanding how much memory you need to serve a VLM
 • 
Benjamin Marie
2
Multimodal RAG with ColPali and Qwen2-VL on Your Computer
Retrieve and exploit information from PDFs without OCR
 • 
Benjamin Marie
3
The Weekly Kaitchup #58
AdEMAMix - FLUTE
 • 
Benjamin Marie
Introducing Minivoc: Faster and Memory-Efficient LLMs Through Vocabulary Reduction [WIP]
From 128k to 32k tokens
 • 
Benjamin Marie
GuideLLM: Is Your Server Ready for LLM Deployment?
Simulate real-world inference workloads with GuideLLM
 • 
Benjamin Marie
GGUF Quantization with Imatrix and K-Quantization to Run LLMs on Your CPU
Fast and accurate GGUF models for your CPU
 • 
Benjamin Marie
The Weekly Kaitchup #57
OLMoE - GuideLLM - vLLM 0.6.0
 • 
Benjamin Marie
3
Falcon Mamba, Jamba, RWKV... Can You Use Them on Your Computer?
A close look at quantization and parameter-efficient fine-tuning (LoRA/QLoRA) for SSMs, RWKV, and hybrid models
 • 
Benjamin Marie
Announcing The Kaitchup's Book: LLMs on a Budget [Pre-sales Open]
Learn how to fine-tune, quantize, run, and serve LLMs on consumer hardware
 • 
Benjamin Marie
5
Run Qwen2-VL on Your Computer with Text, Images, and Video, Step by Step
Your local multimodal chat model
 • 
Benjamin Marie
4

August 2024

The Weekly Kaitchup #56
NanoFlow - Comparison of LLM Inference Services (Accuracy) - Zamba2-1.2B
 • 
Benjamin Marie
© 2024 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture