v0.5.0

Feature

• Integrate OCR visualization (#121) (b39f2e7)
• Add the segmentation layout evaluations in the consolidated excel report. Update mypy overrides. (#120) (c4e7de0)
• Update OCREvaluator with additional metrics (#78) (17e9fde)

Fix

• Add the bbox to TableData from annotations (#123) (c4fe51f)
• Treat th and td as equal for TEDS calculation (#114) (dbf9db7)
• Add support for Google, AWS, and Azure prediction providers in cli (#115) (e8e7421)

v0.4.0

Feature

• Extend the FileProvider and the CLI to accept parameters that control the source of the prediction images (#111) (42e1615)
• Improvements for the MultiEvaluator (#95) (04fe2d9)
• Add extra args for docling-provider and default annotations for CVAT (#98) (7903b6a)
• Introduce SegmentedPage for OCR (#91) (be0ff6a)
• Update CVAT for multi-page annotation, utility to create sliced PDFs (#90) (28d166d)
• Add area level f1 (#86) (54d013b)

Fix

• Small fixes (#108) (0628fa6)
• Layout text not correctly populated in AWS prediction provider, add tests (#100) (6441688)
• Dataset feature spec fixes, cvat improvements (#97) (b79dd19)
• Update boto3 AWS client to accept service credentials (#88) (4e01d0b)
• Handle unsupported END2END evaluation and fix variable name in OCR (#87) (75311da)
• Propagate cvat parameters (#82) (1e2040a)

Documentation

• Update README.md (#84) (518f684)

Release v0.3.0

What's Changed

• feat: Update GoogleDocAIPredictionProvider to use service account creds by @samiuc in #73
• fix: Add CLI option for FileDatasetBuilder by @cau-git in #76
• feat: Consolidate multiple evaluation results and generate a comparison matrix by @nikos-livathinos in #64
• feat: OCR evaluator by @cau-git @samiuc in #63

Full Changelog: v0.2.0...v0.3.0

Release v0.2.0

What's Changed

• dev: Add DocVQA questions, more fixes by @cau-git in #58
• docs: Add README for Docling-DPBench by @cau-git in #60
• feat: Azure prediction provider by @cau-git in #50
• fix: Ensure that evaluators skip data samples without the SUCCESS, PARTIAL_SUCCESS status by @nikos-livathinos in #66
• feat: Support for S3 datasource by @praveenmidde in #65
• feat: PixParse OCR dataset builder by @cau-git in #61
• fix: Address table export_to_html deprecation by @cau-git in #67
• feat: AWS Textract and Google DocAI Prediction providers by @cau-git in #62
• feat: Refactor CVAT builder by @cau-git in #68
• fix: Address missing conversion status (PENDING), add artifacts path, remove unused CLI args by @cau-git in #69
• feat: FileDatasetBuilder by @cau-git in #70

Full Changelog: v0.1.0...v0.2.0

Release v0.1.0

Initial release