Timothyxxx
172123ab2c
Support downsampling; Fix bugs in windows a11y tree; Add a11y_tree trim
2024-03-25 18:02:48 +08:00
David Chang
15e01e7ccc
ver Mar20thv2
...
fixed bugs in server/main.py (_create_pywinauto_node and
get_screen_size)
finished migration of a few task configs to Windows
fixed bug in python.py
2024-03-20 22:22:57 +08:00
David Chang
6149061621
ver Mar20th
...
fixed a bug in _create_pywinauto_node
2024-03-20 14:25:09 +08:00
Timothyxxx
eeae1442cd
Add execute timeout to server; Fix error examples
2024-03-18 20:42:57 +08:00
David Chang
e166106b6a
ver Mar15th
...
added an option to keep buttons without text information but with an
image for SoM setting
2024-03-15 22:46:14 +08:00
Timothyxxx
c2aa009ed8
Update server script, baseline and running script
2024-03-13 15:04:19 +08:00
David Chang
f08fa4912c
ver Mar10th
...
changed AT element filtering
2024-03-10 18:03:02 +08:00
David Chang
96e2c6ee34
ver Feb20th
...
fixed server/main.py
fixed several sheetcopilot tasks
fixed several calc metrics, including float difference of sheet_data and
conditional formatting recognition
2024-02-20 17:11:25 +08:00
rhythmcao
3184f091a8
fix error in long video recording in server/main.py
2024-02-02 07:24:26 +08:00
David Chang
13cd053b1a
Merge branch 'zdy'
2024-01-30 21:14:57 +08:00
David Chang
14dbc708a4
ver Jan30thv2
...
debugged on windows platform with new _create_pywinauto_node function
migrated example task from calc to excel
2024-01-30 21:09:53 +08:00
David Chang
da306376da
ver Jan30th
...
updated function to get AT on Windows
2024-01-30 20:06:58 +08:00
Timothyxxx
d5d9fc56de
Fix minor bugs of get_terminal output caused by a11y tree depth
2024-01-30 18:48:00 +08:00
BlankCheng
80e08a2ff8
Expand user directory on server /launch and /execute'
2024-01-29 21:52:27 +08:00
BlankCheng
7d2d8c855e
Merge main
2024-01-29 21:51:26 +08:00
BlankCheng
284d6fb379
Add human operation time log
2024-01-29 21:42:16 +08:00
David Chang
297a080284
ver Jan27thv2
...
updated get_accessibility_tree and added a series of try-catch
2024-01-27 21:29:20 +08:00
David Chang
b7e3e1f7d0
ver Jan26thv2
...
fixed bugs by incomplete merging
2024-01-26 23:40:20 +08:00
David Chang
773c5ed40c
ver Jan26thv4
...
updated linearized_accessibility_tree to add a column of "text"
removed replacement chars like uFFFC in thunderbird
2024-01-26 23:29:09 +08:00
David Chang
78c7b702b3
ver Jan26th
...
fixed the too long time consuming of massy AT nodes
added special handling for libreoffice calc
2024-01-26 12:30:41 +08:00
rhythmcao
f194fb8d75
add multi_apps; update chrome utilities
2024-01-25 13:53:19 +08:00
Timothyxxx
303c89411e
Fix bugs of a11y tree when the tag is empty
2024-01-23 14:37:54 +08:00
Timothyxxx
7e61ab7e53
Minor fix to support "~/" like part in path parameter
2024-01-22 22:55:15 +08:00
David Chang
21314346c5
ver Jan18thv4
...
added a comment about accessing AT on windows
2024-01-18 22:22:51 +08:00
David Chang
00deae465a
ver Jan18thv3
...
updated get_accessibility_tree in server/main.py to give place for other
os-es and desktops
2024-01-18 21:40:49 +08:00
David Chang
ffc4c32bac
ver Jan17th
...
updated the existing task configs
2024-01-17 17:27:08 +08:00
Timothyxxx
c68796e842
Fix minor bugs
2024-01-15 13:52:13 +08:00
Timothyxxx
1141232d80
Merge remote-tracking branch 'origin/main'
...
# Conflicts:
# desktop_env/controllers/setup.py
2024-01-15 13:51:11 +08:00
Timothyxxx
24169a65d0
Accomplish the exp scripts v1; Add video recording and trajectory recording of desktop agent; Fix minor bugs
2024-01-15 13:49:48 +08:00
David Chang
fc289a3427
Merge branch 'main' into zdy
2024-01-15 12:12:05 +08:00
David Chang
59fdd9f1a2
ver Jan14th
...
setup method for Thunderbird composing tasks
2024-01-14 23:16:54 +08:00
Timothyxxx
d52b692ee5
Finish loading the vscode examples v1; Improve on the infra: Add accessibility tree into the observation; Add activate window function, etc
2024-01-14 18:30:49 +08:00
rhythmcao
d4116458ff
1. fix quote and \ characters in execute_command ; 2. add terminal output text as extra observation ; 3. move get_vm_*() to reset()
2024-01-12 18:09:05 +08:00
David Chang
127a101994
Merge branch 'main' into zdy
2024-01-11 23:02:00 +08:00
David Chang
27eaf2f5d5
ver Jan11th
...
finally set up a simple task, or which should be simple
2024-01-11 20:03:33 +08:00
Timothyxxx
287876affc
Merge remote-tracking branch 'origin/main'
...
# Conflicts:
# desktop_env/evaluators/getters/__init__.py
# desktop_env/evaluators/metrics/__init__.py
# requirements.txt
2024-01-10 23:20:49 +08:00
Timothyxxx
49ece15ac3
VLC v1 finished, improve on instructions, improve on infra
2024-01-10 23:18:30 +08:00
David Chang
cebae4b183
Merge branch 'main' into zdy
2024-01-10 22:16:25 +08:00
David Chang
cf5d480f44
ver Jan10th
...
new Thunderbird task config
2024-01-10 17:36:59 +08:00
Timothyxxx
abcafce750
VLC updates, and some infra bugs fix
2024-01-09 23:14:06 +08:00
Timothyxxx
fa84b20ea5
VLC updates, and some infra bugs fix
2024-01-09 09:30:11 +08:00
David Chang
eeb8a120d6
ver Jan5th
...
debugged
2024-01-05 15:20:47 +08:00
David Chang
5fedf5b891
ver Jan4th
...
updated interfaces for thunderbird evaluation, not tested
2024-01-04 22:41:57 +08:00
Timothyxxx
9f0898fbd5
Fix the cursor logo placement for ubuntu
2023-12-28 15:37:18 +08:00
David Chang
15a63074bc
Merge branch 'zdy'
2023-12-25 21:05:44 +08:00
David Chang
ade9002da4
Merge branch 'main' into zdy
2023-12-25 20:29:20 +08:00
David Chang
82e3353f65
ver Dec25th
...
added cache and upload function for setup
2023-12-25 14:40:30 +08:00
Timothyxxx
236fcb0938
Refactor examples; Start to load examples into benchmark; vlc initialization
2023-12-25 00:24:13 +08:00
David Chang
de24fa91ba
Merge branch 'zdy'
2023-12-21 10:42:18 +08:00
David Chang
f4949c3e90
ver Dec20th
...
fixed bug caused by windows-only os.startfile
2023-12-20 20:55:47 +08:00
