SemanticScuttle - klotz.me

klotz: tool calling* + inference*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. Tool Calling Guide for Local LLMs

   This guide explains how to use tool calling with local LLMs, including examples with mathematical, story, Python code, and terminal functions, using llama.cpp, llama-server, and OpenAI endpoints.

   2026-02-06 Tags: tool calling, llm, unsloth, llama.cpp, llama-server, openai, function calling, python, terminal, inference by klotz
2. Unsloth: running Qwen3-Coder-Next

   Qwen3-Coder-Next is an 80B MoE model with 256K context designed for fast, agentic coding and local use. It offers performance comparable to models with 10-20x more active parameters and excels in long-horizon reasoning, complex tool use, and recovery from execution failures.

   2026-02-04 Tags: qwen3-coder-next, llm, coding, model, local, inference, quantization, vllm, llama.cpp, tool calling by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0