SemanticScuttle - klotz.me

Tags: llama* + github*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. melodysdreamj/WizardVicunaLM: LLM that combines the principles of wizardLM and vicunaLM

   2023-08-26 Tags: wizard-vicuna, wizard-vicuna-lm, melodysdreamj, llm, llama, chat, github by klotz
2. jlonge4/local_llama: This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

   2023-06-25 Tags: llama.cpp, llama, pdf, chat, self-hosted, github, jlonge, hacks by klotz
3. abetlen/llama-cpp-python: Python bindings for llama.cpp

   llama-cpp-python offers a web server which aims to act as a drop-in replacement for the OpenAI API. This allows you to use llama.cpp compatible models with any OpenAI compatible client (language libraries, services, etc).

   2023-06-09 Tags: openai, llama.cpp, llama, python, api, foss, github by klotz
4. shawwn/llama: Inference code for LLaMA models

   2023-06-05 Tags: llm, llama, github, inference, python by klotz
5. Llama.Cpp

   # obtain the original LLaMA model weights and place them in ./models
   ls ./models
   65B 30B 13B 7B tokenizer_checklist.chk tokenizer.model
   
   # install Python dependencies
   python3 -m pip install -r requirements.txt
   
   # convert the 7B model to ggml FP16 format
   python3 convert.py models/7B/
   
   # quantize the model to 4-bits (using q4_0 method)
   ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin q4_0
   
   # run the inference
   ./main -m ./models/7B/ggml-model-q4_0.bin -n 128

   2023-06-05 Tags: github, llama, llama cpp, llm, self-hosted by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0