Commit Graph

248 Commits

Author SHA1 Message Date
Timothyxxx
7e61ab7e53 Minor fix to support "~/" like part in path parameter 2024-01-22 22:55:15 +08:00
David Chang
6bdc0fb3e2 Merge branch 'zdy' 2024-01-22 14:37:13 +08:00
David Chang
7a85c76369 ver Jan22nd
updated all the existing calc configs
2024-01-22 12:42:50 +08:00
tsuky_chen
7a9bd11f94 Merge branch 'main' of https://github.com/ztjhz/DesktopEnv 2024-01-22 05:07:30 +08:00
tsuky_chen
ec23be3ecb update get source to docs; process youtube,stackoverflow,superuser,ubuntu and normal web respectively 2024-01-22 05:07:12 +08:00
Timothyxxx
ce51d16bb3 Loading Impress v1 batch 2024-01-22 02:41:17 +08:00
David Chang
552491f765 ver Jan21stv2
fixed bugs
updated parts of configs
2024-01-21 23:55:04 +08:00
David Chang
4514c32269 ver Jan21st
reconstructed calc metrics
not updated the configs yet
2024-01-21 22:55:52 +08:00
tsuky_chen
613a2199ed modify libreoffice impress examples 2024-01-21 00:43:50 +08:00
tsuky_chen
6807cc0cc2 add get Source 2 Doc Func 2024-01-20 22:22:06 +08:00
Siheng Zhao
3ef1a11d08 Merge branch 'main' of github.com:ztjhz/DesktopEnv 2024-01-20 19:45:47 +08:00
Siheng Zhao
980f7290eb add vscode examples 2024-01-20 19:44:52 +08:00
Timothyxxx
6f27c5bf50 Wrap up SeeAct implementation 2024-01-20 19:19:37 +08:00
Timothyxxx
f88331416c Refactor baselines code implementations 2024-01-20 18:55:21 +08:00
Timothyxxx
09f3e776ae Initialize all baselines: screenshot, a11y tree, both, SoM, SeeAct 2024-01-20 00:13:46 +08:00
Timothyxxx
46bd3386dd Support input screenshot and a11y tree altogether 2024-01-19 20:34:47 +08:00
Timothyxxx
bdd21d06ca Fix minor bugs 2024-01-19 20:34:11 +08:00
David Chang
e4055ab798 Merge branch 'zdy' 2024-01-18 23:46:25 +08:00
David Chang
21314346c5 ver Jan18thv4
added a comment about accessing AT on windows
2024-01-18 22:22:51 +08:00
David Chang
00deae465a ver Jan18thv3
updated get_accessibility_tree in server/main.py to give place for other
  os-es and desktops
2024-01-18 21:40:49 +08:00
David Chang
4af19fb777 Merge branch 'zdy' 2024-01-18 18:06:00 +08:00
David Chang
119a79e4fa ver Jan18thv2
updated metrics.__init__ with new check_data_validations
2024-01-18 18:04:18 +08:00
David Chang
a97c865c0c ver Jan18th
completed all the incomplete tasks stored under libreoffice_calc before
added metric check_data_validations
2024-01-18 17:54:53 +08:00
rhythmcao
91824f754c 1. extend evaluator to list (compatible with single evaluator) 2. fix a variable name error in metrics/general.py 2024-01-18 14:12:54 +08:00
Timothyxxx
2efc6a5b16 Merge remote-tracking branch 'origin/main' 2024-01-18 01:44:13 +08:00
Timothyxxx
b60eb2a933 VM resolution adjust support 2024-01-18 01:43:57 +08:00
David Chang
d3a9e5088d Merge branch 'zdy' 2024-01-17 22:48:30 +08:00
David Chang
19214f2107 ver Jan17thv2
updated compare_table with compare the shown value through exported csv
2024-01-17 22:43:26 +08:00
tsuky_chen
ba8ae104cf update impress eval examples 2024-01-17 18:00:20 +08:00
David Chang
ffc4c32bac ver Jan17th
updated the existing task configs
2024-01-17 17:27:08 +08:00
David Chang
196d9d27b9 Merge branch 'zdy' 2024-01-16 22:49:52 +08:00
David Chang
3f335f47c6 Merge branch 'main' into zdy 2024-01-16 22:48:35 +08:00
David Chang
42afb708c5 ver Jan16thv2
remained thunderbird examples
2024-01-16 22:45:52 +08:00
Timothyxxx
20b1d950a0 FIx corner cases (val connection in chrome when using playwright, and action parsing for agent, and accessibility tree xml handling) 2024-01-16 22:00:01 +08:00
David Chang
99c83805e5 ver Jan16th
updated template.json
2024-01-16 17:50:12 +08:00
Timothyxxx
186bf2e97c Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent 2024-01-16 16:43:32 +08:00
Timothyxxx
48a86d36cf Minor updates 2024-01-16 12:15:21 +08:00
Timothyxxx
6336a31419 Merge remote-tracking branch 'origin/main' 2024-01-16 11:58:35 +08:00
Timothyxxx
8efa692951 Add raw accessibility-tree based prompting method (but the tokens are too large); Minor fix some small bugs 2024-01-16 11:58:23 +08:00
tsuky_chen
91823b1bcd Merge branch 'main' of https://github.com/ztjhz/DesktopEnv 2024-01-16 01:07:54 +08:00
tsuky_chen
9fe3a5db3b update libreoffice impress eval 2024-01-16 01:07:40 +08:00
Timothyxxx
28d8c0c528 Merge remote-tracking branch 'origin/main' 2024-01-15 21:58:45 +08:00
Timothyxxx
493b719821 Add gemini agent implementation; Add missed requirements; Minor fix some small bugs 2024-01-15 21:58:33 +08:00
David Chang
82798bff6f ver Jan15thv4
fixed errors in server/README
2024-01-15 18:27:29 +08:00
David Chang
81d97efedd Merge branch 'main' into zdy 2024-01-15 17:10:40 +08:00
David Chang
5dc633393f Merge branch 'zdy' 2024-01-15 17:08:38 +08:00
David Chang
4c87e11864 ver Jan15thv3
scheduled closing?
2024-01-15 16:46:34 +08:00
David Chang
00922923ee ver Jan15thv2
thunderbird example w.r.t. unified folder
2024-01-15 15:56:01 +08:00
Timothyxxx
c68796e842 Fix minor bugs 2024-01-15 13:52:13 +08:00
Timothyxxx
1141232d80 Merge remote-tracking branch 'origin/main'
# Conflicts:
#	desktop_env/controllers/setup.py
2024-01-15 13:51:11 +08:00