SemanticScuttle - klotz.me

klotz: text-generation-webui*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Difference between “chat”, “instruct”, and “chat-instruct”? : LocalLLaMA

   hat - chat directly, character card is your prompt
   
   instruct- chat between "you" and "assistant" using the model's prompt format
   
   chat-instruct- chat with you and a character card as a prompt but with the instruct template applied. .i.e "you are an AI playing x character, respond as the character would" converted to alpaca, wizard or whatever
   
   There is no best, but for factual information, you probably want to keep to instruct mode. instruct-chat doesn't necessarily play the characters better or make them write longer. It's sort of hit or miss. one may work better than the other for a particular model and prompt.

   2023-11-19 Tags: chat, instruct, chat-iinstruct, text-generation-webui, llm, prompt engineering by klotz
2. DavG25/text-generation-webui-code_syntax_highlight: An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets

   2023-07-22 Tags: github, davg25, text-generation-webui, extension, code, syntax, visualization, llm, chat by klotz
3. How to get oobabooga/text-generation-webui running on Windows or Linux with LLaMa-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 start to finish.

   How to get oobabooga/text-generation-webui running on Windows or Linux with LLaMa-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 start to finish.

   2023-07-22 Tags: oogabookga, text-generation-webui, linux, llama, nvidia, rtx 3090, gtpq by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0