SemanticScuttle - klotz.me

klotz: small language models* + gemma*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

1. The Optimal Architecture for Small Language Models

   This article details research into finding the optimal architecture for small language models (70M parameters), exploring depth-width tradeoffs, comparing different architectures, and introducing Dhara-70M, a diffusion model offering 3.8x faster throughput with improved factuality.

   2025-12-27 Tags: llm, nlp, small language models, architecture, diffusion, llama, gemma, deep learning by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0