← Back to opportunity board
OPP-DRAFT-CLUSTER-6d9d300255f52e47805bData, documents, and knowledge workPUBLISHED

Parse complex documents without losing tables, layout, or uncertainty

Four accessible, PII-free observations form one repeated signal across one source policy and four independent author groups. Publication followed evidence-completeness and similarity checks.

V2 · Repeated observationHuman confirmation requiredMedium riskUpdated 2026-10-20
Public observations are not real-task outcomes

The excerpts below come from public pages that were accessible at the latest check. Validation advances only when the corresponding behavior evidence passes review.

Sign in to confirm, save, or build

Writing data requires ChatGPT sign-in. Public browsing does not.

01 · PROBLEM & USER

What is the user trying to accomplish?

Persona
Development and data teams processing PDFs, HTML, and specialist documents at scale
Trigger
A document contains complex tables, formulas, hidden text, or layered layouts and must feed downstream search or automation.
JTBD
When complex tables, formulas, hidden text, or layered layouts must feed search and automation, preserve structure, coordinates, and source fragments, detect missing content, and route uncertain regions to review.
Current workaround
Teams combine parsers, OCR, and custom rules, then manually sample outputs for missing tables, layout shifts, or hidden content.
Desired outcome
Preserved structure, coordinates, and source fragments, with missing or uncertain regions automatically routed to review.
02 · EVIDENCE CHAIN

Original observations and source status

OBSERVATION 01GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-09-19
“feat: optional HTML field on RAG chunk records Motivation Docling already converts to a structured DoclingDocument and exports retrieval chunks as JSONL via --to chunks. Each ChunkedDocumentResultItem carries text, raw_text, headings, captions, doc_items, page_numbers, and metadata (including origin). It does not carry the HTML of the items in that chunk. Marker's --output_format chunks puts full HTML on each…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-discussion-D_kwDOMT5TYM4ApYmaACCESSIBLEPublished 2026-09-19Captured 2026-10-20Source ACCESSIBLE · 2026-10-20Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @mvanhornMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 02GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-09-18
“Hi Malte and team; Teams building enterprise RAG on Haystack need high throughput in document-loading components. AnyDoc converts heavy PDFs and tables to clean Markdown in seconds, boosting pipeline efficiency. Founder's Lock: the first 100 get lifetime 50% off ($14.50/mo instead of $29) plus 5,000 free pages in month one. Details: https://www.ostlertech.com/anydoc Best, OstlerTech Team”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-discussion-D_kwDODTYuls4ApWm7ACCESSIBLEPublished 2026-09-18Captured 2026-10-20Source ACCESSIBLE · 2026-10-20Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @yasinbeygirci-makerApache-2.0 · repository contribution ↗
Correct this record or request removal
OBSERVATION 03GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-09-11
“### Problem In the `pypdfium2` PDF backend, `PyPdfiumPageBackend._object_rects` / `has_content_in` re-enumerate every object on the page on each call. `has_content_in` is invoked per layout cluster (2-3 times each), so on a page with many objects the cost is O(clusters × objects), and text extraction via `get_text_bounded` is O(rects × chars). A page with a large number of path/text objects makes conversion…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5427591482ACCESSIBLEPublished 2026-09-11Captured 2026-09-12Source ACCESSIBLE · 2026-09-15Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @wittjeffMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 04GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-09-05
“### Bug When the table structure model returns a grid that leaves a PDF word outside every row band and every column band, `MatchingPostProcessor._pick_orphan_cells` in docling-ibm-models drops that word, and because the layout stage already assigned it to the table cluster, docling never emits it as text either. The word is absent from the `DoclingDocument`, the Markdown and the JSON export. On a dense public…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5356905417ACCESSIBLEPublished 2026-09-05Captured 2026-09-05Source ACCESSIBLE · 2026-10-20Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @bharm16MIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 05GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-31
“## Question / proposal Is Docling interested in a vendor-neutral profile for embedding a versioned `DoclingDocument` JSON representation in the source PDF, so later consumers can load it instead of repeating PDF parsing, layout inference, and OCR? PDF 2.0 Associated Files and PDF/A-4f already provide a plausible container. A minimal interoperability profile could define: - the embedded file media type and…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5305251427ACCESSIBLEPublished 2026-08-31Captured 2026-09-01Source ACCESSIBLE · 2026-09-14Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @thedjpetersenMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 06GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-30
“**Is your feature request related to a problem? Please describe.** When processing PDFs with `DocumentCleaner(remove_repeated_substrings=True)`, documents that are effectively empty after cleaning still pass through downstream. For example: - A scanned-image page → extracted text is `" "` (whitespace only) - A footer-only page → after `remove_repeated_substrings=True`, content becomes `""` - A chapter-title page…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5291239732ACCESSIBLEPublished 2026-08-30Captured 2026-08-30Source ACCESSIBLE · 2026-09-15Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @rautaditya2606Apache-2.0 · repository contribution ↗
Correct this record or request removal
OBSERVATION 07GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-27
“## Bug Since v2.116.0 (the layout-driven OCR pipeline refactor in #3710), table extraction can misalign row labels and numeric values on PDFs where the embedded native PDF text layer is only partially reliable — common for auto-generated Chinese/Japanese/Korean regulatory filings, where some table cells carry real native PDF text and others are effectively garbled or image-backed and need OCR. ## What we observed…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5266133499ACCESSIBLEPublished 2026-08-27Captured 2026-08-27Source ACCESSIBLE · 2026-09-15Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @loickouaoMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 08GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-27
“## Feature request: extract embedded MathML / native structured equations before formula reconstruction ### Description Does Docling currently detect and extract a structured mathematical representation that is already embedded in the source document, instead of reconstructing the formula visually using the formula enrichment model? In particular, modern accessible/tagged PDFs can contain a MathML representation…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5265900919ACCESSIBLEPublished 2026-08-27Captured 2026-08-27Source ACCESSIBLE · 2026-09-15Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @PeterStaar-IBMMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 09GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-24
“This is a docling-core schema proposal (that repo has discussions disabled, so posting here). Follow-up to #301 and companion to docling PR #4055, which extracts the AcroForm widget layer and is the concrete producer that wants to write these attributes. 1. Motivation DoclingDocument's form model (FormItem + GraphData, the field_* labels) represents visible page content: every GraphCell documents its text/orig as…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-discussion-D_kwDOMT5TYM4AovUkACCESSIBLEPublished 2026-08-24Captured 2026-08-25Source ACCESSIBLE · 2026-10-20Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 10GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-22
“### Bug When parsing arXiv HTML generated by LaTeXML, Docling preserves the surrounding text but completely loses the contents of HTML ` ` elements. The source HTML contains valid ` ` elements with standard ` `, ` `, ` `, ` `, ` `, and ` ` elements. However, after conversion with `DocumentConverter`, the resulting DoclingDocument JSON does not contain the table cell contents, and `export_to_markdown()`…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5223356731ACCESSIBLEPublished 2026-08-22Captured 2026-08-25Source ACCESSIBLE · 2026-10-20Snapshot v2
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @medjmalamiMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 11GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-18
“The PR #3934 drafted a first declarative backend, `IWorkPagesDocumentBackend`, to parse Apple's iWork Pages documents. The backend needs some improvements to pair the capabilities of similar backend parsers like `MsWordDocumentBackend` for Word documents. Just drop a line if you're interested in resolving this issue. Make sure to follow the…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-5185057714ACCESSIBLEPublished 2026-08-18Captured 2026-08-25Source ACCESSIBLE · 2026-09-16Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsAuthor: @ceberamMIT · repository contribution ↗
Correct this record or request removal
OBSERVATION 12GitHub · Public Issues & Discussions
ACCESSIBLE · 2026-08-13
“From: YRA Tech (document-accessibility tooling; Docling is the structural backbone of our conversion pipeline). Prior upstream work: docling#3803 (supersample), docling-parse#299/#300/#301/#314, the MLX conversion kit for docling#3943. Summary. We convert documents into tagged, PDF/UA-conformant PDFs using DoclingDocument as our canonical model. Docling's layout, table, and reading-order components are the…”
Full provenance and capture record
OBS-LIVE-GITHUB-PUBLIC-ISSUES-discussion-D_kwDOMT5TYM4Aod9sACCESSIBLEPublished 2026-08-13Captured 2026-08-25Source ACCESSIBLE · 2026-09-14Snapshot v1
GitHub · Public Issues & DiscussionsGitHub REST + GraphQL API · 许可白名单仓库 Issues 与 DiscussionsMIT · repository contribution ↗
Correct this record or request removal
03 · AI PATH

How far can AI assist today?

01Identify document type, layout, and object relationships
02Combine parser and OCR results while detecting structural anomalies
03Write missing content, conflicts, and source coordinates into a quality report

Human gates that must remain

  • Review critical tables and formulas before downstream use
  • Retain original files and parser versions
04 · COUNTEREVIDENCE & UNKNOWNS

Why is this not a solved or validated need yet?

Counterevidence / alternatives

  • Mainstream parsing services already cover standard layouts.
  • Complex layouts may still require domain-specific rules.

Evidence not yet obtained

  • Whether structural semantics can be unified across formats
  • The compute cost of page-level quality inspection at scale
05 · VALIDATION LADDER

From public signal to completed real work

V0 HypothesisV1 Single signalV2 Repeated signalV3 User confirmationV4 Completed actionV5 Prototype deliveredV6 Real taskV7 Repeat useV8 Sustained outcome

Current reviewed evidence: 0 independent confirmations, 0 completed-action records, and 0 prototype-feedback records. A click, contact authorization, or development plan never upgrades the stage automatically.

Editorial judgment: The brief passed evidence-completeness and similarity checks. It is still a repeated-signal hypothesis, not customer, adoption, or product-market-fit evidence.

06 · OPPORTUNITY HANDOFF

Evaluate this opportunity without copying the evidence manually.

Opportunity Handoff v1

A read-only export of the task, evidence references, AI path, human gates, counterevidence, unknowns, and validation boundary.

Opening the form does not submit an issue. A person still decides whether the semantic fit is valid.
07 · BUILDER PROGRESS

Public solution plans and trial results

No reviewed builder plan yet

Any developer may submit a non-exclusive plan. A plan does not change the opportunity validation stage.

08 · VERSION HISTORY

How this public brief changed

v21AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v20AUTO_DRAFT_EVIDENCE_REFRESH
v19AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v18AUTO_DRAFT_EVIDENCE_REFRESH
v17AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v16AUTO_DRAFT_EVIDENCE_REFRESH
v15AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v14AUTO_DRAFT_EVIDENCE_REFRESH
v13AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v12AUTO_DRAFT_EVIDENCE_REFRESH
v11AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v10AUTO_DRAFT_EVIDENCE_REFRESH
v9AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v8AUTO_DRAFT_EVIDENCE_REFRESH
v7AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v6AUTO_DRAFT_EVIDENCE_REFRESH
v5AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v4AUTO_DRAFT_THRESHOLD_RESTORED
v3AUTO_DRAFT_THRESHOLD_REVOKED
v2AUTO_EVIDENCE_AND_UNIQUENESS_PASSED
v1AUTO_CLUSTER_DRAFT_CREATED
Submit a correction or removal request