Skip to content

feat(opendataloader_pdf): add optional batch bisection to skip bad PDFs - #4147

Open
maxdswain wants to merge 3 commits into
deepset-ai:mainfrom
maxdswain:opendataloader-skip-bad-pdfs
Open

maxdswain wants to merge 3 commits into
deepset-ai:mainfrom
maxdswain:opendataloader-skip-bad-pdfs

Conversation

@maxdswain

Copy link
Copy Markdown
Contributor

Related Issues

Proposed Changes:

Add optional batch bisection to skip bad PDFs to prevent conversion failures from a single bad PDF.

How did you test it?

Added unit and integration tests.

Notes for the reviewer

Checklist

@maxdswain
maxdswain requested a review from a team as a code owner October 21, 2026 20:17
@maxdswain
maxdswain requested review from julian-risch and removed request for a team October 21, 2026 20:17
@github-actions

Copy link
Copy Markdown
Contributor

Hi @maxdswain, thanks for your interest in contributing to Haystack! 🙏

⚠️ You currently have 3 open pull requests in this repository (#4048, #4014 and this one). Our review capacity is limited, so please hold off opening more PRs until we've had a chance to review your first 2 open PRs. This helps us give each contribution the attention it deserves. Thank you!

This is an automated message to help us keep the review queue healthy.

@github-actions github-actions Bot added integration:opendataloader-pdf type:documentation Improvements or additions to documentation labels Oct 21, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Coverage report (opendataloader_pdf)

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  integrations/opendataloader_pdf/src/haystack_integrations/components/converters/opendataloader_pdf
  converter.py
Project Total  

This report was generated by python-coverage-comment-action

@julian-risch julian-risch left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @maxdswain . Looks quite good to me already. One suggestion for a change. Other than that I am ready to approve the PR.

@maxdswain

Copy link
Copy Markdown
Contributor Author

Hi @julian-risch I've addressed all of your review comments, this should be ready to be merged.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

integration:opendataloader-pdf type:documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add optional failure recovery for bad PDFs in OpenDataLoaderConverter

2 participants