SemanticScuttle - klotz.me

Tags: positional embeddings* + rope*

0 bookmark(s) - Sort by: Date ↓ / Title /

1. Microsoft AI Released LongRoPE2: A Near-Lossless Method to Extend Large Language Model Context Windows to 128K Tokens While Retaining Over 97% Short-Context Accuracy

   Microsoft researchers introduce LongRoPE2, a method to extend large language model context windows to 128K tokens while maintaining over 97% short-context accuracy, addressing key limitations in positional embeddings.

   2025-03-04 Tags: llm, rope, longrope2, positional embeddings, microsoft by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0