Commit Graph

191 Commits

Author SHA1 Message Date
Timothyxxx
24169a65d0 Accomplish the exp scripts v1; Add video recording and trajectory recording of desktop agent; Fix minor bugs 2024-01-15 13:49:48 +08:00
Timothyxxx
f153a4c253 Add 'WAIT', 'FAIL', 'DONE' to the action space; Debug basic prompting-based GPT-4 and Gemini agents; Initialize experiments script; 2024-01-14 23:36:19 +08:00
Timothyxxx
d52b692ee5 Finish loading the vscode examples v1; Improve on the infra: Add accessibility tree into the observation; Add activate window function, etc 2024-01-14 18:30:49 +08:00
Timothyxxx
2228f346a9 Fix minor bugs caused from merging in setupcontroller; Initialize vscode example loading 2024-01-14 00:51:26 +08:00
Siheng Zhao
347160a35f update vsc 2024-01-13 23:20:36 +08:00
Timothyxxx
0242657b86 Minor fix on gimp examples name 2024-01-13 23:13:11 +08:00
Timothyxxx
57a41a279c Resolve conflicts 2024-01-13 22:58:20 +08:00
Timothyxxx
a1c3e4c294 Finish Chrome example loading v1 2024-01-13 22:56:50 +08:00
Siheng Zhao
f274193265 Merge branch 'main' of github.com:ztjhz/DesktopEnv 2024-01-13 18:14:31 +08:00
Siheng Zhao
105fd35683 implement action replay for vscode and gimp evaluation 2024-01-13 17:53:13 +08:00
David Chang
2f6974a59a Merge branch 'zdy' 2024-01-13 17:17:51 +08:00
David Chang
005b054a0b Merge branch 'main' into zdy 2024-01-13 17:15:32 +08:00
tsuky_chen
136b52c876 eval gimp compare pics 2024-01-13 01:49:46 +08:00
tsuky_chen
1a5aa39611 Merge branch 'main' of https://github.com/ztjhz/DesktopEnv 2024-01-13 01:46:02 +08:00
tsuky_chen
a841f27a9d update gimp examples eval 2024-01-13 01:45:46 +08:00
David Chang
d4192d3d9c ver Jan12thv3
debugged
2024-01-13 00:06:11 +08:00
David Chang
e08df57129 ver Jan12thv2
sqlite3 metric
2024-01-12 23:07:00 +08:00
Timothyxxx
bc88ee0c41 Minor fix of the logic of vm ip get 2024-01-12 21:18:59 +08:00
rhythmcao
d4116458ff 1. fix quote and \ characters in execute_command ; 2. add terminal output text as extra observation ; 3. move get_vm_*() to reset() 2024-01-12 18:09:05 +08:00
Timothyxxx
186df65683 Merge remote-tracking branch 'origin/main'
# Conflicts:
#	desktop_env/controllers/setup.py
#	desktop_env/evaluators/metrics/utils.py
2024-01-12 17:30:15 +08:00
Timothyxxx
5a93a32958 Update on Chrome examples; Refactor on logic of controlling 2024-01-12 17:24:47 +08:00
Siheng Zhao
d6f694da1c update GIMP examples and eval 2024-01-12 16:36:02 +08:00
Siheng Zhao
b3109bf856 update vscode eval extension: eval-0.0.1.vsix 2024-01-12 16:14:41 +08:00
tsuky_chen
85f64e884c 2 init gimp examples 2024-01-12 16:10:10 +08:00
tsuky_chen
e79235f568 2 init gimp example 2024-01-12 16:07:55 +08:00
David Chang
5160619783 ver Jan12th
quickly fixed two thunderbird examples
2024-01-12 12:19:23 +08:00
David Chang
5b0b1ff9f2 Merge branch 'zdy' 2024-01-11 23:04:21 +08:00
David Chang
127a101994 Merge branch 'main' into zdy 2024-01-11 23:02:00 +08:00
David Chang
3c04872dcf ver Jan11thv2
a new Thunderbird example w.r.t. email filter
2024-01-11 22:43:38 +08:00
tsuky_chen
b30d87bba8 Merge branch 'main' of https://github.com/ztjhz/DesktopEnv 2024-01-11 21:29:42 +08:00
tsuky_chen
96d2e09054 update writer examples 9-15 2024-01-11 21:28:11 +08:00
Timothyxxx
820579a5a2 Make up missing getters and metrics; Update VLC scripts; Start to work on Chrome, update examples instructions 2024-01-11 21:27:40 +08:00
David Chang
27eaf2f5d5 ver Jan11th
finally set up a simple task, or which should be simple
2024-01-11 20:03:33 +08:00
tsuky_chen
b20027884a update writer examples 1-8 2024-01-11 18:52:30 +08:00
tsuky_chen
ad21037f93 Update 0e47de2a-32e0-456c-a366-8c607ef7a9d2.json 2024-01-11 14:01:11 +08:00
tsuky_chen
b224fdec31 Update 6ada715d-3aae-4a32-a6a7-429b2e43fb93.json 2024-01-11 13:56:19 +08:00
tsuky_chen
bb8bade1ca Update ecc2413d-8a48-416e-a3a2-d30106ca36cb.json 2024-01-11 13:54:37 +08:00
tsuky_chen
7fa1bf5cdd Update 6ada715d-3aae-4a32-a6a7-429b2e43fb93.json 2024-01-11 13:51:50 +08:00
tsuky_chen
ab2a49fed9 Update 4bcb1253-a636-4df4-8cb0-a35c04dfef31.json 2024-01-11 13:47:22 +08:00
tsuky_chen
e45cc2673b Update 4bcb1253-a636-4df4-8cb0-a35c04dfef31.json 2024-01-11 13:07:19 +08:00
Timothyxxx
287876affc Merge remote-tracking branch 'origin/main'
# Conflicts:
#	desktop_env/evaluators/getters/__init__.py
#	desktop_env/evaluators/metrics/__init__.py
#	requirements.txt
2024-01-10 23:20:49 +08:00
Timothyxxx
49ece15ac3 VLC v1 finished, improve on instructions, improve on infra 2024-01-10 23:18:30 +08:00
David Chang
031b0d07ab ver Jan10thv2
updated document
2024-01-10 23:10:54 +08:00
David Chang
8d5b6875cf ver Jan10th
a quick introduction to accessibility tree interface
2024-01-10 23:05:24 +08:00
David Chang
5e2a03720d ver Jan10thv4
updated /home/david to /home/user
2024-01-10 22:33:33 +08:00
David Chang
611dca9ab6 Merge branch 'zdy' 2024-01-10 22:31:17 +08:00
David Chang
18cc1fc52c ver Jan10thv3
minor fixes
2024-01-10 22:23:48 +08:00
David Chang
cebae4b183 Merge branch 'main' into zdy 2024-01-10 22:16:25 +08:00
David Chang
1515b05666 ver Jan10thv2
a new example config for Thunderbird
fixed several bugs
2024-01-10 21:58:29 +08:00
Siheng Zhao
ad74da9d0b update vscode 2024-01-10 21:25:14 +08:00