SemanticScuttle - klotz.me

klotz: llama* + llm*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Gemma vs. Llama vs. Mistral: Exploring Smaller AI Models

   This article compares the performance of smaller language models Gemma, Llama 3, and Mistral on reading comprehension tasks. The author highlights the trend of smaller, more accessible models and discusses Apple's recent foray into the field with its own proprietary model.

   2024-08-07 Tags: llm, gemma, llama, mistral by klotz
2. Achieving Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, vLLM)

   This blog post benchmarks and compares the performance of SGLang, TensorRT-LLM, and vLLM for serving large language models (LLMs). SGLang demonstrates superior or competitive performance in offline and online scenarios, often outperforming vLLM and matching or exceeding TensorRT-LLM.

   2024-07-27 Tags: sglang, tensorrt-llm, vllm, llama, llm by klotz
3. A Beginner-Friendly Introduction to LLMs

   This article provides a beginner-friendly introduction to Large Language Models (LLMs) and explains the key concepts in a clear and organized way.

   2024-05-10 Tags: llm, introduction, bert, palm, gpt, llama by klotz
4. An explanation of why you should not include a trailing whitespace at the end of your prompts (ChatGPT, Llama, etc.) : r/LocalLLaMA

   2024-04-19 Tags: llm, reddit, llama, whitespace, prompt engineering by klotz
5. 14 Free Large Language Models Fine-Tuning Notebooks

   - 14 free colab notebooks providing hands-on experience in fine-tuning large language models (LLMs).
   - The notebooks cover topics from efficient training methodologies like LoRA and Hugging Face to specialized models such as Llama, Guanaco, and Falcon.
   - They also include advanced techniques like PEFT Finetune, Bloom-560m-tagger, and Meta_OPT-6–1b_Model.

   2024-02-10 Tags: llm, lora, hugging face, llama, guanaco, falcon, peft, fine tune, mpt-instruct, phi, self-supervised, rlhf by klotz
6. How to fine-tune an open-source LLaMa using QLoRa

   2024-01-28 Tags: llm, qlora, llama, fine tuning, quantization by klotz
7. hackerllama - The Llama Hitchiking Guide to Local LLMs

   2024-01-14 Tags: llama, llm, lists by klotz
8. Deploy and run LLM on Raspberry Pi 5 vs Raspberry Pi 4B (LLaMA, LLaMA2, Phi-2, Mixtral-MOE, mamba-gpt) - DFRobot

   deploy and run LLM (large language models), including LLaMA, LLaMA2, Phi-2, Mixtral-MOE, and mamba-gpt, on the Raspberry Pi 5 8GB.

   2024-01-10 Tags: llm, rpi5, rpi, llama, mistral, self-hosted, dfrobot by klotz
9. Collection thread for llava accuracy : r/LocalLLaMA

   2023-12-04 Tags: llava, self-hosted, llama, llm, vision, reddit by klotz
10. Introducing Unsloth

    2023-12-01 Tags: llm, llama, fine tuning by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0