This article details building a Retrieval-Augmented Generation (RAG) system to assist with research paper tasks, specifically question answering over a PDF document. It covers document loading, splitting, embedding with Sentence Transformers, using ChromaDB as a vector database, and implementing a query interface with LangChain.
This article details a method for converting PDFs to Markdown using a local LLM (Gemma 3 via Ollama), focusing on privacy and efficiency. It involves rendering PDF pages as images and then using the LLM for content extraction, even from scanned PDFs.
A toolkit for training language models to work with PDF documents in the wild, including prompting strategies, evaluation tools, filtering, finetuning code, and processing PDFs through finetuned models.
The article discusses the process of preparing PDFs for use in Retrieval-Augmented Generation (RAG) systems, with a focus on creating graph-based RAGs from annual reports containing tables. It highlights the benefits of Graph RAGs over vector store-backed RAGs, particularly in terms of reasoning capabilities, and explores the construction of knowledge graphs for better information retrieval. The author shares insights into the challenges and solutions involved in building an enterprise-ready graph data store for RAG applications.
MarkItDown is a utility for converting various files to Markdown, including PDF, PowerPoint, Word, Excel, Images, Audio, HTML, text-based formats, and ZIP files.
How to read and convert PDFs to Markdown for better RAG results with LLMs.
Docling is a tool that parses documents and exports them to desired formats like Markdown and JSON. It supports various document formats and provides advanced PDF understanding, metadata extraction, and integration with LlamaIndex and LangChain for RAG / QA applications.
Docling is a tool that parses documents and exports them to desired formats like Markdown and JSON. It supports various document formats including PDF, DOCX, PPTX, Images, HTML, AsciiDoc, and Markdown.
A guided series of tutorials/notebooks to build a PDF to Podcast workflow using Llama models for text processing, transcript writing, dramatization, and text-to-speech conversion.
- Approximate Tokens, Words and Characters Calculator for LLM's and Text Trimmer — Simple calculator to estimate tokens for Large Language Models and text editor to trim text
- Text File Merger for LLM — This tool combines multiple text files into a single document, with clear separation between files
- PDF to TXT Converter — Convert PDF documents to plain text format for use with LLMs and text analysis
- HTML to TXT Converter — Remove HTML tags and extract clean text content for LLM processing
- LLM System Prompt Generator — Generate optimized system prompts for different LLM model sizes (3B, 33B, 70B, etc.)
- Creative Idea Generator — AI-powered brainstorming tool for generating creative solutions and ideas
