Tags: andyyyy64*

0 bookmark(s) - Sort by: Date ↓ / Title /

  1. An open-source command-line tool designed to identify the optimal local Large Language Model specifically suited for a user's existing or planned hardware. It automatically detects GPU, CPU, and RAM capacity to rank HuggingFace models using real performance benchmarks instead of relying on parameter size alone.

    * Hardware auto-detection for NVIDIA, AMD, Apple Silicon, and CPUs
    * Intelligent ranking based on benchmark evidence and recency awareness
    * Capability to simulate different GPUs for hardware upgrade planning
    * Support for GGUF, AWQ, and GPTQ model formats
    * Streamlined workflows including one-command chat sessions and Python code snippet generation

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: tagged with "andyyyy64"

About - Propulsed by SemanticScuttle