A technical guide to running lightweight OCR models (LightOnOCR, GLM-OCR, Deepseek-OCR) on low-end hardware using llama.cpp. Includes implementation details for CLI, REST APIs, and performance optimization.
Topics Covered:
- llama.cpp OCR integration
- Low-spec hardware optimization
- CLI & REST API setup
- Quantization & Prompting
- Hallucination mitigation
Topics Covered:
- llama.cpp OCR integration
- Low-spec hardware optimization
- CLI & REST API setup
- Quantization & Prompting
- Hallucination mitigation
LiteParse is a lightweight, open‑source PDF parsing tool that delivers fast, high‑quality spatial text extraction with bounding boxes. Built on PDF.js and Tesseract.js, it runs entirely locally without cloud dependencies, supporting PDF, Office, and image formats via automatic conversion. Users can parse documents via a CLI or as a library, generate high‑resolution screenshots, and integrate custom OCR servers through a simple API. Ideal for production pipelines, LiteParse offers JSON or text outputs, precise bounding boxes, and multi‑platform support across Linux, macOS, and Windows.
A polyglot document intelligence framework with a Rust core that extracts text, metadata, and structured information from PDFs, Office documents, images, and 50+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, TypeScript (Node/Bun/Wasm/Deno) or use via CLI, REST API, or MCP server.
MinerU is a tool that converts PDFs into machine-readable formats (e.g., markdown, JSON), allowing for easy extraction into any format.
| **Model** | **Parameters (B)** | **Main Strength** | **Special Capabilities** | **Best Use Case** |
|----------------------|--------------------|------------------------------|-------------------------------------------------------|---------------------------------------------------|
| olmOCR-2-7B-1025 | 7 | High-accuracy document OCR | GRPO RL training, equation/table OCR | Large-scale document pipelines, technical PDFs |
| PaddleOCR v5/VL | 1 | Multilingual parsing (109 langs) | Text, tables, formulas, charts, dynamic visual encoder | Global multilingual OCR, efficient inference |
| OCRFlux-3B | 3 | Markdown-accurate parsing | Cross-page merging, vLLM optimization | PDF-to-Markdown, consumer GPU friendly |
| MiniCPM-V 4.5 | 8 | State-of-the-art multimodal OCR| Video OCR, high-resolution images, fast/deep modes | Mobile/edge OCR, video understanding |
| InternVL 2.5-4B | 4 | Efficient OCR & reasoning | Dynamic tiling, strong text extraction | Resource-limited environments, multi-image/video |
| Granite Vision 3.3 2b| 2 | Visual document understanding| Charts, tables, diagrams, segmentation, multi-page QA| Enterprise document extraction |
| TrOCR Large Printed | 0.6 | Clean printed-text OCR | 16x16 patch encoder, BEiT/RoBERTa | Simple, high-quality printed text extraction |
|----------------------|--------------------|------------------------------|-------------------------------------------------------|---------------------------------------------------|
| olmOCR-2-7B-1025 | 7 | High-accuracy document OCR | GRPO RL training, equation/table OCR | Large-scale document pipelines, technical PDFs |
| PaddleOCR v5/VL | 1 | Multilingual parsing (109 langs) | Text, tables, formulas, charts, dynamic visual encoder | Global multilingual OCR, efficient inference |
| OCRFlux-3B | 3 | Markdown-accurate parsing | Cross-page merging, vLLM optimization | PDF-to-Markdown, consumer GPU friendly |
| MiniCPM-V 4.5 | 8 | State-of-the-art multimodal OCR| Video OCR, high-resolution images, fast/deep modes | Mobile/edge OCR, video understanding |
| InternVL 2.5-4B | 4 | Efficient OCR & reasoning | Dynamic tiling, strong text extraction | Resource-limited environments, multi-image/video |
| Granite Vision 3.3 2b| 2 | Visual document understanding| Charts, tables, diagrams, segmentation, multi-page QA| Enterprise document extraction |
| TrOCR Large Printed | 0.6 | Clean printed-text OCR | 16x16 patch encoder, BEiT/RoBERTa | Simple, high-quality printed text extraction |
NVIDIA Nemotron Parse v1.1 is designed to understand document semantics and extract text and tables elements with spatial grounding. It transforms unstructured documents into actionable and machine-usable representations.
IBM is releasing Granite-Docling-258M, an ultra-compact and cutting-edge open-source vision-language model (VLM) for converting documents to machine-readable formats while preserving layout, tables, equations, and more. It's designed for accurate and efficient document conversion and excels beyond simple text extraction.
Docling simplifies document processing, parsing diverse formats — including advanced PDF understanding — and providing seamless integrations with the gen AI ecosystem.
This document details a custom OCR program designed for recovering old computer programs from line-printer listings. It focuses on accuracy for mono-spaced fonts, even at the cost of speed, and outlines the algorithm, implementation details, and necessary preparation steps.
This article details a method for converting PDFs to Markdown using a local LLM (Gemma 3 via Ollama), focusing on privacy and efficiency. It involves rendering PDF pages as images and then using the LLM for content extraction, even from scanned PDFs.
