The Kaitchup Pro

The Kaitchup Pro is the highest tier of The Kaitchup. It includes the following benefits and services:

• Priority support

• Up to 5 custom AI notebook requests per year (more notebooks possible for additional charges)

• Full access to The Salt

• Early access to The Kaitchup’s research

• 30% discount for group subscriptions

• The Kaitchup’s book

• Up to 5 reviews of papers (scientific, technical reports, blog posts, etc.) per year (more reviews possible for additional charges)

• Everything already included in The Kaitchup paid subscription

• Priority requests and 20% discount on all the LLM services by The Kaitchup (available from mid-September 2024)

Some of the benefits and services won’t be fully launched before September.

Details of the Benefits

Priority support

If there is a notebook that doesn’t work for you or an article that isn’t clear, send me a direct message through Substack and I’ll help you. I currently answer paid subscribers within 24 hours but as The Kaitchup is growing fast I cannot guarantee that I will be able to maintain this response time.

If you are a Kaitchup Pro subscriber, I’ll answer you in priority.

Custom AI notebook requests

If The Kaitchup publishes an AI notebook and you wish to adapt it for another dataset, model, or settings, you can request a customized version. With a Pro subscription, you are entitled to up to 5 requests, handled one at a time per customer. Additional requests can be made for an extra charge.

Requests can be made through Substack direct message.

Full access to The Salt

Your subscription to The Kaitchup Pro includes a paid subscription to The Salt, my other newsletter more focused on research, for one year. This subscription is renewed at the same time as your Kaitchup Pro subscription is renewed. Note: For now, I manually activate the subscription to The Salt once the subscription to The Kaitchup Pro is validated by Substack. It can take several hours before I activate the subscription to The Salt.

If you are already a yearly subscriber to The Salt, and if you used the same email for your subscription to The Kaitchup Pro, you will get your money back for the time remaining on your current subscription to The Salt. Then, your current subscription to The Salt will be extended by one year.

Early access to The Kaitchup’s research

The Kaitchup is currently conducting scientific research on LLMs’ efficiency, LLM evaluation, multilingual LLMs, and machine translation.

The Kaitchup Pro subscribers will receive exclusive articles presenting The Kaitchup’s scientific research. I’ll send these articles to Kaitchup Pro subscribers at least two weeks before publishing on arXiv (or submitting to conferences/journals). Some of these exclusive articles will be accompanied by code and private models.

The first of these exclusive articles will be published in late August/beginning of September 2024.

Note: Writing these articles will take time and cost a lot of money, I’ll only publish a few of them during the year (my target is 4 publications/year).

30% discount for group subscriptions to The Kaitchup

The standard group discount applied is 20%. If you are a Pro subscriber, this discount is 30%. To get this discount, register as a Pro subscriber and then DM me on Substack. I’ll send you a coupon.

Note: Group subscription is primarily intended for your employees, collaborators, and friends. I don’t forbid reselling The Kaitchup subscriptions, however, make sure to check that what you want to do is allowed by Substack's terms of use.

The Kaitchup’s book

I’m currently writing a book on parameter-efficient fine-tuning for LLMs. It is compiling The Kaitchup articles in chapters going in-depth into all the important aspects that were not tackled by the articles. Annotated notebooks will also be published along with this book. You can find more details about the book here:

Announcing The Kaitchup's Book: LLMs on a Budget [Pre-sales Open]

This book is included in The Kaitchup Pro subscription.

Note: If you already have bought the book, you will get your money back after you become a Pro subscriber.

Reviews of papers and blog posts

I regularly review papers for top-tier conferences and journals such as NeurIPS, ICLR, AAAI, ICML, EMNLP (outstanding reviewer in 2019), ACL, TACL, etc.

I can also review your paper, or any technical writing, about LLMs (or machine translation), for instance before you submit to arXiv or a conference. I’ll check its technical accuracy, that related work is cited, and that the evaluation is scientifically credible (and provide suggestions on how to improve it if it’s not). Note: I won’t review papers that are already under review for a conference for which I’m part of the program committee.

However, note that I’m not a native English speaker. This is not an English proofreading service.

Review requests can be made through Substack's direct message. Pro subscribers can make up to 5 requests per year with no more than one request at a time per subscriber. 10 pages max. per review (typical conference paper length). Additional requests can be made for additional charges.

Note: If you need the review fast, i.e., within a day or two, then additional charges may apply.

Everything already included in The Kaitchup paid subscription

A subscription to The Kaitchup Pro also includes everything included in the regular subscription. If you already have a paid subscription, you can upgrade through your Substack account and everything will be managed directly by Substack. If you have any questions about the process of switching from the regular to Pro subscription, please reach out to me or Substack.

Priority requests and 20% discount on all the LLM services provided by The Kaitchup

From Mid-September 2024

The Kaitchup will offer the following services for LLMs:

• LLM quantization: If you want to reduce the size of your LLMs while preserving their accuracy. The Kaitchup will search for the best quantization method and hyperparameters and will deliver a quantized model.

• LLM fine-tuning: If you want to adapt an LLM to a specific domain or task. The Kaitchup will deliver a fine-tuned model or adapter.

• LLM Evaluation: If you want to evaluate an LLM on some benchmarks. The Kaitchup will deliver a spreadsheet with all the scores.

• LLMs for non-English languages: If you want to fine-tune an LLM for a specific language. The Kaitchup will deliver the LLM trained to better tackle tasks in this language.

• Machine translation models: If you want a translation model, The Kaitchup will deliver a translation model following the constraints indicated at the time of the order. I have 10+ years of expertise in machine translation technologies.

All models are tested and evaluated before delivery. They are ready for deployment. A code showing how to use them is also provided.

Prices for these services are not completely decided yet. Some indicative examples are:

• Quantization for LLMs of up to 10B parameters with a standard quantization method (e.g., GPTQ, AWQ, or AutoRound) will cost $50, or $40 for Kaitchup Pro subscribers.

• Fine-tuning a QLoRA adapter for Llama 3 8B on a dataset with 10k samples will cost $150, or $120 for Kaitchup Pro subscribers.

• Fine-tuning a QLoRA adapter for Llama 3 70B on a dataset with 10k samples will cost $400, or $300 for Kaitchup Pro subscribers.

I’ll launch a webpage describing the pricing in September 2024.

These services will be proposed publicly, not only to The Kaitchup paid subscribers, but Pro subscribers will be served first and with a 20% discount valid for all the orders made as long as they remain Pro subscribers.

I only work asynchronously: no calls, no meetings.

Moreover, note that I cannot guarantee that I will be able to perform all the requested tasks. Depending on how many jobs I have to run, I may have to refuse to take more but Pro subscribers will have the priority.

More details on how to make an order will be published by September.