SemanticScuttle - klotz.me

klotz: nvidia* + llama*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. How to log output of running models and performance monitoring

   A discussion post on Reddit's LocalLLaMA subreddit about logging the output of running models and monitoring performance, specifically for debugging errors, warnings, and performance analysis. The post also mentions the need for flags to output logs as flat files, GPU metrics (GPU utilization, RAM usage, TensorCore usage, etc.) for troubleshooting and analytics.

   2024-06-12 Tags: llama, python, logging, performance, monitoring, gpu, metrics, debugging, nvidia, analytics, product lion engineering, llms by klotz
2. How to get oobabooga/text-generation-webui running on Windows or Linux with LLaMa-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 start to finish.

   How to get oobabooga/text-generation-webui running on Windows or Linux with LLaMa-30b 4bit mode via GPTQ-for-LLaMa on an RTX 3090 start to finish.

   2023-07-22 Tags: oogabookga, text-generation-webui, linux, llama, nvidia, rtx 3090, gtpq by klotz
3. Reddit LocalLlama GPU / CPU

   2023-06-09 Tags: llama, llama.cpp, llm, reddit, gpu, nvidia, 3090, 4090, machine learning by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0