Firecrawl introduces pdf-inspector, a high-performance Rust library designed for rapid PDF classification, text extraction, and Markdown conversion. By sampling content streams to quickly distinguish between text-based and scanned documents, the tool enables intelligent routing that bypasses costly OCR services for standard PDFs. It delivers position-aware text extraction, automated table and column detection, and robust encoding handling while maintaining a lightweight footprint with no external ML dependencies or model training requirements.
- Provides bindings for Python, Node.js, and browser WebAssembly environments.
- Achieves sub-200ms processing times on large corpora while outperforming several established local parsers in reading order and table accuracy.
- Features per-page OCR routing suggestions to optimize mixed-format document workflows.
- Handles complex layouts including RTL text, multi-column newspapers, and CID-encoded fonts.
- Released under the MIT license with active community contributions and CI/CD automation.
- Provides bindings for Python, Node.js, and browser WebAssembly environments.
- Achieves sub-200ms processing times on large corpora while outperforming several established local parsers in reading order and table accuracy.
- Features per-page OCR routing suggestions to optimize mixed-format document workflows.
- Handles complex layouts including RTL text, multi-column newspapers, and CID-encoded fonts.
- Released under the MIT license with active community contributions and CI/CD automation.
MinerU is a tool that converts PDFs into machine-readable formats (e.g., markdown, JSON), allowing for easy extraction into any format.
This article details a method for converting PDFs to Markdown using a local LLM (Gemma 3 via Ollama), focusing on privacy and efficiency. It involves rendering PDF pages as images and then using the LLM for content extraction, even from scanned PDFs.
Microsoft has open-sourced MarkItDown, a state-of-the-art application designed to convert various file types into Markdown format for seamless integration, collaboration, and accessibility. The tool supports multiple file formats, including PDFs, PowerPoint presentations, Word documents, Excel spreadsheets, images, audio, HTML, text-based formats, and ZIP files, making it a versatile utility for users across different domains.
Docling is a tool that parses documents and exports them to desired formats like Markdown and JSON. It supports various document formats including PDF, DOCX, PPTX, Images, HTML, AsciiDoc, and Markdown.
