Tags: document intelligence* + rag*

0 bookmark(s) - Sort by: Date ↓ / Title /

  1. Angela Shi writes about reconstructing missing Tables of Contents in PDFs by analyzing body typography to facilitate better Retrieval-Augmented Generation. When native outlines are absent, the approach uses six deterministic signals—including font size ratios and numeric prefixes—to identify potential headings. This method then employs an LLM validation loop to filter false positives from these candidates before integrating them into a structured data frame for RAG pipelines.

    - Scoring is based on variables like boldness, alignment, text length, and blank lines above segments.
    - The approach includes modes for extending partial outlines or reconciling composite documents with re-starting numbering.
    - LLM validation can improve precision from as low as 7% to over 90% in certain document sets.
    - A secondary "tagging" layer allows thematic retrieval by mapping specific business concepts onto the structural hierarchy.
  2. Context engineering shifts RAG focus from prompt tuning to structured data assembly for LLM calls. The single-document architecture utilizes four bricks—parsing, question parsing, retrieval, and generation—to produce typed context pieces. These include system prompts, filtered document segments, and structured metadata. This engineering discipline improves auditability, enables caching, and supports scalable component composition.

    - Four-brick pipeline: parsing, question parsing, retrieval, generation
    - Typed data outputs for LLM context assembly
    - Fixed system prompts for caching efficiency
    - Filtered document lines and structured metadata
    - Improved auditability and cost control

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: tagged with "document intelligence+rag"

About - Propulsed by SemanticScuttle