* Enhance SetupController with improved logging and error handling during setup and file upload processes. Update instance type to t3.xlarge and AMI ID for AWS configuration. Add download progress logging and exception handling for better debugging.
* Enhance VLC status evaluation by adding multiple paths for file and URL information extraction, improving robustness against varying VLC XML structures. Implement detailed logging for better debugging and error handling in case of mismatches or missing data. Update example JSON for VLC evaluation to use a valid HLS stream URL.
* Improve audio comparison robustness in VLC evaluator by adding error handling for audio file loading and extraction. Implement detailed logging for empty or corrupt files, and normalize DTW distance calculation for more accurate similarity scoring. Remove deprecated audio fingerprint comparison function.
---------
Co-authored-by: yuanmengqi <yuanmengqi@mail.ustc.edu.cn>
* Refactor evaluator structure in LibreOffice Writer example JSON to support multiple expected and result files, enhancing evaluation flexibility.
* Update instance type to t3.large and add VNC access URL logging for allocated VMs, enhancing remote access capabilities.
* Update instance type to t3.large and add VNC access URL logging for allocated VMs, enhancing remote access capabilities.
* Update time format in get_vm_file function to include hours, minutes, and seconds for more precise file naming with time suffix.
* More delay for 936321ce-5236-426a-9a20-e0e3c5dc536f; support one more potential solutions.
* Enhance SetupController with configurable retry limit and improved error handling for file opening requests. Introduce new function to compare unique training records, and update logging for better debugging. Adjust JSON examples for evaluation to support multiple expected and result files.
* Clean debug code
* Enhance DesktopEnv to track environment usage for optimized snapshot management. Introduce is_environment_used flag to determine if a snapshot revert is necessary based on provider type. Update setup and step methods to mark environment usage appropriately. Add new execute_with_verification method in SetupController for command execution with result verification, improving reliability. Change AWS instance type to m5.large for better performance and update AMI ID for compatibility. Update file opening logic in main.py to handle both file paths and application commands more effectively.
---------
Co-authored-by: yuanmengqi <yuanmengqi@mail.ustc.edu.cn>
* Refactor evaluator structure in LibreOffice Writer example JSON to support multiple expected and result files, enhancing evaluation flexibility.
* Update instance type to t3.large and add VNC access URL logging for allocated VMs, enhancing remote access capabilities.
* Update instance type to t3.large and add VNC access URL logging for allocated VMs, enhancing remote access capabilities.
* Update time format in get_vm_file function to include hours, minutes, and seconds for more precise file naming with time suffix.
* More delay for 936321ce-5236-426a-9a20-e0e3c5dc536f; support one more potential solutions.
* Enhance SetupController with configurable retry limit and improved error handling for file opening requests. Introduce new function to compare unique training records, and update logging for better debugging. Adjust JSON examples for evaluation to support multiple expected and result files.
* Clean debug code
---------
Co-authored-by: yuanmengqi <yuanmengqi@mail.ustc.edu.cn>
* fix: /cursor_position api return format fix
* chore: update README.md to remove deprecated command
* fix: add base score for evaluators and minor bug fixes
* fix: add base score for setup configurations
---------
Co-authored-by: Jiaqi Deng <jiaqideng@Jiaqis-MacBook-Pro.local>
* Initial commit
* Accelarate a11y tree acquisition
* Clean code
* Leave todos for Windows and macOS
* Prepare for support of win and macos
* Prepare for support of win and macos
* Minor fix
* add preliminary support for macos
* fix subtle bugs
* Clean the windows a11y tree getter code
* Clean the windows a11y tree getter code
* Intermediate version
* Intermediate version
* Update
* adding support for macos
* Delete dummy
* Delete dummy
* add bounding box for pruning
* Delete dummy
* FIX: enable a11y tree fetching on Windows
* Move the requirement depency item place
* FIX: remove "jsonify" from return value of get a11y tree
* FIX: change print into logger, decompose functions in _create_pywinauto_node
* Update
* remove redundant nodes on macos
* remove reliance of pywinauto
* Clean
* Fix bugs for pywinauto a11y_tree acquisition
* FEAT: only fetch active windows, skip repeated nodes
* CHORE: clean code, add comments on time-consuming part, add connection logger.info
* FEAT: 1. add attrs including class_name, id, count... 2. use multithread to accelerate
* FIX: add code of getting writable properties
* Clean, update the max_depth for macOS
* FIX: get all active windows
* Accelarate child nodes in macOS
* FEAT: get all active windows, add timing when testing
* CHORE: remove print
* Clean and finalize
* Clean and finalize
---------
Co-authored-by: Timothyxxx <384084775@qq.com>
Co-authored-by: Junli Wang <ltnsxdxd@gmail.com>
Co-authored-by: YangJL2003 <yangjl22@mails.tsinghua.edu.cn>
reduced time to acquire AT from at-spi from ~5 s to ~3.5 s
* refined acquisition of States and Attributes
* canceled acquisition of Component when node is not showing and
visible according to the document
(https://gnome.pages.gitlab.gnome.org/at-spi2-core/libatspi/iface.Component.html)
* pruned windowcoord and parentcoord, merged size and screencoord into
one at-spi invocation
* canceled acquisition of Document
* refined acquisition of RoleName
fixed server/main.py
fixed several sheetcopilot tasks
fixed several calc metrics, including float difference of sheet_data and
conditional formatting recognition
