Commit Graph

30 Commits

Author SHA1 Message Date
yuanmengqi
0651495d88 fix: Enhance error handling and logging across multiple evaluators
- Added logging for file retrieval and error handling in file.py, improving robustness during file operations.
- Implemented checks for file existence and parsing errors in general.py, enhancing reliability in JSON/YAML processing.
- Improved table comparison logic in table.py with detailed error logging for sheet loading and cell value reading.
- Enhanced metrics evaluation in slides.py with additional checks for paragraph and run counts, ensuring thorough comparison.
- Updated utils.py to include file existence checks and detailed error logging during cell value reading.
2025-07-14 05:43:17 +00:00
Shenzhennan
29caebb765 Impress check and fix (all font compare issue) (#247)
* Enhance PPTX comparison logic in slides.py

- Improved alignment comparison to treat None and LEFT as equivalent.
- Added special handling for font bold and italic properties to consider None and False as equivalent.
- Introduced a new bullet comparison function that allows for minor differences and tolerates formatting variations.
- Updated JSON examples to support multiple file comparisons and results.

* fix all fonts json file f23ac

* fix clean the shape examination in unrelevatn part-top position check

* Refactor JSON structure for PPTX comparison

- Updated the instruction formatting for clarity.
- Modified the comparison logic to support multiple expected and result files, enhancing flexibility in evaluations.
- Changed the function key to an array to accommodate multiple comparison functions.
- Introduced a conjunction key to specify logical relationships between comparisons.

* fix impress-e4ef0baf by adding all fonts gold file

* update impress bf4e9888 task ins

* fix impress b8adbc24 font size

* Enhance PPTX comparison functionality in slides.py

- Introduced a debug logger for detailed output during PPTX comparisons.
- Added a new function to recursively retrieve all text shapes, including those within groups.
- Enabled debug logging to provide insights on slide and shape comparisons.
- Updated JSON examples to support multiple expected and result files for enhanced evaluation flexibility.

* Enable debug logging by default in PPTX comparison and enhance debug output for shape mismatches. Updated JSON examples to support multiple expected and result files for improved evaluation consistency.

* fix impress all fons compare file

* Refactor PPTX comparison logic and JSON examples for height modification tasks

- Added critical notes in slides.py to clarify the execution order of shape examination and height modification checks.
- Updated JSON examples to support multiple expected and result files, enhancing evaluation consistency.
- Ensured that examine_shape must be set to False for examine_modify_height to function correctly, preventing premature termination of comparisons.

* Enhance debug logging in PPTX comparison for detailed font attribute mismatches

- Added debug logging for differences in font color, bold, italic, and underline attributes during table cell comparisons.
- Improved clarity of debug output by including specific slide, shape, and cell indices for mismatches.
- Ensured that existing comparison logic remains intact while enhancing debugging capabilities.

* Enhance debug logging for font attribute mismatches in PPTX comparison

- Added detailed debug logging for font name and size mismatches during PPTX comparisons, including specific slide, shape, and paragraph indices.
- Updated JSON examples to support multiple expected and result files, improving evaluation consistency.
- Maintained existing comparison logic while enhancing debugging capabilities.

* fix impress 3161de json file

---------

Co-authored-by: yuanmengqi <yuanmengqi@mail.ustc.edu.cn>
2025-07-10 00:36:32 +08:00
Shenzhennan
1b40a458de Impress eval fix (#226)
* fix compare_pptx

* Fix impress-4ed5abd0-8b5d-47bd-839f-cacfa15ca37a eval script:Fix temporarily by ignoring the contaminated  To fix completely, compare source file needs to be updated

* fix impress domain

* fix a53 by changing gold

* fix impress a53

* fix impress b8d origin file

* add table font color check

* fix left pane check

---------

Co-authored-by: chenjix <3107760494@qq.com>
Co-authored-by: moonshot <moonshot@moonshotznshenMacBook-Pro.local>
Co-authored-by: Shen Zhennan <shenzhennan@moonshot.cn>
2025-07-04 13:32:02 +08:00
tsuky_chen
e55810809e Fix libreoffice impress evaluation (#209)
Co-authored-by: chenjix <211250101@smail.nju.edu.cn>
2025-06-08 22:12:56 +08:00
Eric Patey
bf3f054564 Fix crash caused by referencing an unbound local variable. (#128)
Co-authored-by: Eric Patey <>
2025-02-07 23:31:53 +08:00
MillanK
983283a86a patch: minor bug fixes for evaluator and task configurations, documentation update (#121)
* fix: /cursor_position api return format fix

* chore: update README.md to remove deprecated command

* fix: add base score for evaluators and minor bug fixes

* fix: add base score for setup configurations

---------

Co-authored-by: Jiaqi Deng <jiaqideng@Jiaqis-MacBook-Pro.local>
2025-01-18 22:25:18 +08:00
tsuky_chen
169a0a15ad add libreoffice examples for windows 2024-03-21 15:49:54 +08:00
Timothyxxx
0aae756538 Code clean 2024-03-14 12:54:10 +08:00
tsuky_chen
5b5475094e update multi apps 2024-03-07 01:24:36 +08:00
tsuky_chen
2aad4357b2 Update slides.py 2024-02-28 21:40:53 +08:00
tsuky_chen
cb18d6e52a fixed impress examples 2024-02-28 21:12:10 +08:00
tsuky_chen
83fbae3b0e fixed PPTC examples load 2024-02-22 16:25:35 +08:00
tsuky_chen
dbc0eeec8f fixed PPTC examples load 2024-02-22 01:09:22 +08:00
tsuky_chen
0519b92396 update PPTC examples into impress 2024-02-20 19:58:09 +08:00
tsuky_chen
874c6e8d74 update PPTC examples into impress 2024-02-19 02:05:44 +08:00
tsuky_chen
fd13543ee0 fix slides.py 2024-02-17 01:07:09 +08:00
tsuky_chen
396cfcf8fa update PPTC examples into impress 2024-02-17 01:01:29 +08:00
tsuky_chen
dd1644b3f4 update pptc as libreoffice impress 2024-02-15 01:51:34 +08:00
tsuky_chen
f7bb33724c update pptc as libreoffice impress 2024-02-15 01:49:04 +08:00
Timothyxxx
fdb5655c89 Update chrome examples 2024-02-08 13:49:29 +08:00
Timothyxxx
8dd62178be Fix Impress examples 2024-02-07 21:52:21 +08:00
Timothyxxx
4ef0dd59af Fix an error in impress 2024-02-01 01:30:42 +08:00
Timothyxxx
77af1d1dd3 Fix impress background color check func 2024-01-31 02:01:39 +08:00
Timothyxxx
0e5eefbb86 FIx minor bugs from impress 2024-01-31 01:06:42 +08:00
Timothyxxx
cb7643713e Add impress examples, format the import 2024-01-30 03:25:27 +08:00
Timothyxxx
343813a29b Add impress examples; remove the auto-saving pyautogui commands change to libreoffice pre-setting 2024-01-29 21:34:58 +08:00
Timothyxxx
f9d9895541 Fix some errors found in impress and thunderbird examples 2024-01-29 20:14:47 +08:00
Timothyxxx
37e09a994e Fix some errors found in impress and thunderbird examples 2024-01-29 13:23:06 +08:00
tsuky_chen
394d6353fd update libreoffice impress eval examples 2024-01-28 12:18:25 +08:00
Timothyxxx
42b433dce8 Finish Impress v2 loading, some pre-process left 2024-01-23 15:29:23 +08:00