lzy/sci-gui-agent-benchmark
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
248 Commits 3 Branches 0 Tags
65ea0d04690a6a17a9a1d1e13e1e8b46ee56c7ec
Commit Graph

40 Commits

Author SHA1 Message Date
David Chang
21314346c5 ver Jan18thv4 
added a comment about accessing AT on windows
 2024-01-18 22:22:51 +08:00
David Chang
00deae465a ver Jan18thv3 
updated get_accessibility_tree in server/main.py to give place for other
  os-es and desktops
 2024-01-18 21:40:49 +08:00
David Chang
ffc4c32bac ver Jan17th 
updated the existing task configs
 2024-01-17 17:27:08 +08:00
David Chang
82798bff6f ver Jan15thv4 
fixed errors in server/README
 2024-01-15 18:27:29 +08:00
Timothyxxx
c68796e842 Fix minor bugs 2024-01-15 13:52:13 +08:00
Timothyxxx
1141232d80 Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	desktop_env/controllers/setup.py
 2024-01-15 13:51:11 +08:00
Timothyxxx
24169a65d0 Accomplish the exp scripts v1; Add video recording and trajectory recording of desktop agent; Fix minor bugs 2024-01-15 13:49:48 +08:00
David Chang
fc289a3427 Merge branch 'main' into zdy 2024-01-15 12:12:05 +08:00
David Chang
b9d8e6c631 ver Jan15th 
attachment task of thunderbird
 2024-01-15 11:49:43 +08:00
David Chang
59fdd9f1a2 ver Jan14th 
setup method for Thunderbird composing tasks
 2024-01-14 23:16:54 +08:00
Timothyxxx
d52b692ee5 Finish loading the vscode examples v1; Improve on the infra: Add accessibility tree into the observation; Add activate window function, etc 2024-01-14 18:30:49 +08:00
rhythmcao
d4116458ff 1. fix quote and \ characters in execute_command ; 2. add terminal output text as extra observation ; 3. move get_vm_*() to reset() 2024-01-12 18:09:05 +08:00
David Chang
127a101994 Merge branch 'main' into zdy 2024-01-11 23:02:00 +08:00
David Chang
27eaf2f5d5 ver Jan11th 
finally set up a simple task, or which should be simple
 2024-01-11 20:03:33 +08:00
Timothyxxx
287876affc Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	desktop_env/evaluators/getters/__init__.py
#	desktop_env/evaluators/metrics/__init__.py
#	requirements.txt
 2024-01-10 23:20:49 +08:00
Timothyxxx
49ece15ac3 VLC v1 finished, improve on instructions, improve on infra 2024-01-10 23:18:30 +08:00
David Chang
031b0d07ab ver Jan10thv2 
updated document
 2024-01-10 23:10:54 +08:00
David Chang
8d5b6875cf ver Jan10th 
a quick introduction to accessibility tree interface
 2024-01-10 23:05:24 +08:00
David Chang
cebae4b183 Merge branch 'main' into zdy 2024-01-10 22:16:25 +08:00
David Chang
cf5d480f44 ver Jan10th 
new Thunderbird task config
 2024-01-10 17:36:59 +08:00
Timothyxxx
abcafce750 VLC updates, and some infra bugs fix 2024-01-09 23:14:06 +08:00
Timothyxxx
fa84b20ea5 VLC updates, and some infra bugs fix 2024-01-09 09:30:11 +08:00
David Chang
eeb8a120d6 ver Jan5th 
debugged
 2024-01-05 15:20:47 +08:00
David Chang
5fedf5b891 ver Jan4th 
updated interfaces for thunderbird evaluation, not tested
 2024-01-04 22:41:57 +08:00
Timothyxxx
9f0898fbd5 Fix the cursor logo placement for ubuntu 2023-12-28 15:37:18 +08:00
David Chang
15a63074bc Merge branch 'zdy' 2023-12-25 21:05:44 +08:00
David Chang
ade9002da4 Merge branch 'main' into zdy 2023-12-25 20:29:20 +08:00
David Chang
82e3353f65 ver Dec25th 
added cache and upload function for setup
 2023-12-25 14:40:30 +08:00
Timothyxxx
236fcb0938 Refactor examples; Start to load examples into benchmark; vlc initialization 2023-12-25 00:24:13 +08:00
David Chang
de24fa91ba Merge branch 'zdy' 2023-12-21 10:42:18 +08:00
David Chang
f4949c3e90 ver Dec20th 
fixed bug caused by windows-only os.startfile
 2023-12-20 20:55:47 +08:00
David Chang
b37df609b9 ver Dec20th 
some adaptations to make in run on my device
 2023-12-20 20:14:39 +08:00
Timothyxxx
05d3b5863d Update the script on server for ubuntu 2023-12-18 19:53:22 +08:00
Timothyxxx
2ca36109b5 Initialize evaluation protocols and examples; Implement one kind of eval; Update requirements 2023-12-12 18:10:55 +08:00
Timothyxxx
4ba053998d Improve the logic of env setup; add change wallpaper; add example 2023-12-05 17:32:24 +08:00
Timothyxxx
8301096fd4 Add open_file function in server 2023-12-05 13:10:06 +08:00
Jing Hua
e808cf84a7 setup controller 2023-12-03 21:09:05 +08:00
Timothyxxx
487fb8005b Improve: fix bugs; add back the cursor in screenshot; add pause in env.step 2023-12-02 22:14:50 +08:00
Timothyxxx
e51ef4b91d Make up 2023-12-02 18:02:45 +08:00
Timothyxxx
992d8f8fce Refactor with pyautogui 2023-12-02 17:52:00 +08:00