SemanticScuttle - klotz.me

klotz: llms*

Bookmarks on this page are managed by an admin user.

0 bookmark(s) - Sort by: Date ↑ / Title / - Bookmarks from other users for this tag

1. Finetune LLMs on your own consumer hardware using tools from PyTorch and Hugging Face ecosystem | PyTorch

   efficient method for fine-tuning LLM using LoRA and QLoRA, making it possible to train them even on consumer hardware

   2024-01-12 Tags: llm, fine tuning, qlora, lora, peft, pytorch, hugging face, fine-tuning, llms by klotz
2. How Good Are the Latest Open LLMs? And Is DPO Better Than PPO?

   This article discusses the latest open LLM (large language model) releases, including Mixtral 8x22B, Meta AI's Llama 3, and Microsoft's Phi-3, and compares their performance on the MMLU benchmark. It also talks about Apple's OpenELM and its efficient language model family with an open-source training and inference framework. The article also explores the use of PPO and DPO algorithms for instruction finetuning and alignment in LLMs.

   2024-05-13 Tags: llms, mixtral, mixtral 8x22b, llama 3, phi-3, openelm, ppo, dpo, reinforcement learning, human feedback by klotz

Top of the page

First / Previous / Next / Last / Page 1 of 0