SemanticScuttle - klotz.me

Tags: llama*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. NotebookLlama: An Open Source version of NotebookLM

   A guided series of tutorials/notebooks to build a PDF to Podcast workflow using Llama models for text processing, transcript writing, dramatization, and text-to-speech conversion.

   2024-10-28 Tags: notebookllama, pdf, llama, text processing, foss, facebook by klotz
2. mistral.rs: Running Llama Vision on Mac M2

   Simon Willison explains how to use the mistral.rs library in Rust to run the Llama Vision model on a Mac M2 laptop. He provides a detailed example and discusses the memory usage and GPU utilization.

   2024-10-19 Tags: mistral.rs, llama, vision, rust, simon willison, llm, cli, inference by klotz
3. Gemma vs. Llama vs. Mistral: Exploring Smaller AI Models

   This article compares the performance of smaller language models Gemma, Llama 3, and Mistral on reading comprehension tasks. The author highlights the trend of smaller, more accessible models and discusses Apple's recent foray into the field with its own proprietary model.

   2024-08-07 Tags: llm, gemma, llama, mistral by klotz
4. Achieving Faster Open-Source Llama3 Serving with SGLang Runtime (vs. TensorRT-LLM, vLLM)

   This blog post benchmarks and compares the performance of SGLang, TensorRT-LLM, and vLLM for serving large language models (LLMs). SGLang demonstrates superior or competitive performance in offline and online scenarios, often outperforming vLLM and matching or exceeding TensorRT-LLM.

   2024-07-27 Tags: sglang, tensorrt-llm, vllm, llama, llm by klotz
5. How to log output of running models and performance monitoring

   A discussion post on Reddit's LocalLLaMA subreddit about logging the output of running models and monitoring performance, specifically for debugging errors, warnings, and performance analysis. The post also mentions the need for flags to output logs as flat files, GPU metrics (GPU utilization, RAM usage, TensorCore usage, etc.) for troubleshooting and analytics.

   2024-06-12 Tags: llama, python, logging, performance, monitoring, gpu, metrics, debugging, nvidia, analytics, product lion engineering, llms by klotz
6. A Beginner-Friendly Introduction to LLMs

   This article provides a beginner-friendly introduction to Large Language Models (LLMs) and explains the key concepts in a clear and organized way.

   2024-05-10 Tags: llm, introduction, bert, palm, gpt, llama by klotz
7. An explanation of why you should not include a trailing whitespace at the end of your prompts (ChatGPT, Llama, etc.) : r/LocalLLaMA

   2024-04-19 Tags: llm, reddit, llama, whitespace, prompt engineering by klotz
8. 14 Free Large Language Models Fine-Tuning Notebooks

   - 14 free colab notebooks providing hands-on experience in fine-tuning large language models (LLMs).
   - The notebooks cover topics from efficient training methodologies like LoRA and Hugging Face to specialized models such as Llama, Guanaco, and Falcon.
   - They also include advanced techniques like PEFT Finetune, Bloom-560m-tagger, and Meta_OPT-6–1b_Model.

   2024-02-10 Tags: llm, lora, hugging face, llama, guanaco, falcon, peft, fine tune, mpt-instruct, phi, self-supervised, rlhf by klotz
9. How to fine-tune an open-source LLaMa using QLoRa

   2024-01-28 Tags: llm, qlora, llama, fine tuning, quantization by klotz
10. hackerllama - The Llama Hitchiking Guide to Local LLMs

    2024-01-14 Tags: llama, llm, lists by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0