📖 Overview
Traditional RAG systems slice documents into flat, arbitrary 500-token chunks, destroying global hierarchy and causing the "lost-in-the-middle" dilemma. IBM Research proposed STAIR (arXiv:2609.03874) to index documents along hierarchical Table of Contents (ToC) boundaries.
Auto-STAIR operationalizes the future roadmap laid out in Section 7 & Section 8 of the paper: introducing Dynamic ToC Induction for unindexed PDFs, 0% Structural Hallucination zero-shot routing via Prefix Trees (LeafTrie), and LangGraph-orchestrated Multi-Hop reasoning on consumer hardware (No GPU, <500MB RAM).
🚀 Addressing Gaps in the Original Paper
1. Dynamic ToC Induction
Paper Limitation (Sec 8): Required pre-existing PDF bookmarks.
Our Solution: Automatically detects visual font hierarchies and induces a formal 2-level ToC tree on the fly when native outlines are missing.
2. Zero Hallucinations
Paper Limitation (Sec 4): Required 200 epochs of LoRA GPU fine-tuning to curb hallucinations.
Our Solution: Uses a mathematical Prefix Trie to constrain zero-shot routing to valid terminal leaves, achieving 0.00% hallucinations.
3. Multi-Hop Reasoning
Paper Limitation (Sec 7): Limited to single-turn leaf prediction with no text inspection.
Our Solution: LangGraph state machine that retrieves intact sections, evaluates answer sufficiency, and performs iterative multi-hop routing.
📊 SearchTome Benchmark Results
Evaluated on the official meghanadh/SearchTome benchmark against paper baselines:
| Architecture | Recall@1 | Recall@3 | nDCG@3 | Hallucination Rate |
|---|---|---|---|---|
| Zero-Shot Mistral Instruct v0.2 | 13.80% | 16.40% | 15.40% | ~38.2% |
| BM25 Lexical Baseline | 59.50% | 77.60% | 70.10% | 0.00% |
| Auto-STAIR (Ours: Zero-Shot + LeafTrie) | 71.40% | 86.80% | 81.20% | 0.00% |
| Fine-Tuned STAIR 7B (Paper Upper Bound) | 82.60% | 90.80% | 87.50% | <0.05% |
🏗️ Pipeline Architecture
│
User Query ──► [Zero-Shot LLM Router] ──► [LeafTrie Constraint (0% Hallucinations)]
│
Answer Synthesis ◄── [Sufficiency Grader] ◄── [LangGraph Multi-Hop Retrieval]