lzy/sci-gui-agent-benchmark
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
173 Commits 3 Branches 0 Tags
bc88ee0c41fca1288daf23ffe4493cf4d8637a50
Commit Graph

41 Commits

Author SHA1 Message Date
rhythmcao
d4116458ff 1. fix quote and \ characters in execute_command ; 2. add terminal output text as extra observation ; 3. move get_vm_*() to reset() 2024-01-12 18:09:05 +08:00
Timothyxxx
186df65683 Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	desktop_env/controllers/setup.py
#	desktop_env/evaluators/metrics/utils.py
 2024-01-12 17:30:15 +08:00
Timothyxxx
5a93a32958 Update on Chrome examples; Refactor on logic of controlling 2024-01-12 17:24:47 +08:00
David Chang
127a101994 Merge branch 'main' into zdy 2024-01-11 23:02:00 +08:00
Timothyxxx
820579a5a2 Make up missing getters and metrics; Update VLC scripts; Start to work on Chrome, update examples instructions 2024-01-11 21:27:40 +08:00
David Chang
27eaf2f5d5 ver Jan11th 
finally set up a simple task, or which should be simple
 2024-01-11 20:03:33 +08:00
Timothyxxx
287876affc Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	desktop_env/evaluators/getters/__init__.py
#	desktop_env/evaluators/metrics/__init__.py
#	requirements.txt
 2024-01-10 23:20:49 +08:00
Timothyxxx
49ece15ac3 VLC v1 finished, improve on instructions, improve on infra 2024-01-10 23:18:30 +08:00
David Chang
cebae4b183 Merge branch 'main' into zdy 2024-01-10 22:16:25 +08:00
David Chang
1515b05666 ver Jan10thv2 
a new example config for Thunderbird
fixed several bugs
 2024-01-10 21:58:29 +08:00
David Chang
cf5d480f44 ver Jan10th 
new Thunderbird task config
 2024-01-10 17:36:59 +08:00
Timothyxxx
abcafce750 VLC updates, and some infra bugs fix 2024-01-09 23:14:06 +08:00
Timothyxxx
fa84b20ea5 VLC updates, and some infra bugs fix 2024-01-09 09:30:11 +08:00
David Chang
26b7d9010d Merge branch 'zdy' 2024-01-05 15:55:41 +08:00
David Chang
eeb8a120d6 ver Jan5th 
debugged
 2024-01-05 15:20:47 +08:00
David Chang
5fedf5b891 ver Jan4th 
updated interfaces for thunderbird evaluation, not tested
 2024-01-04 22:41:57 +08:00
Timothyxxx
ab71ebb2ba Initialize VLC getters and metrics, fix some bugs in infra logic, needs to be refactored later on 2024-01-04 17:05:17 +08:00
David Chang
15a63074bc Merge branch 'zdy' 2023-12-25 21:05:44 +08:00
David Chang
ade9002da4 Merge branch 'main' into zdy 2023-12-25 20:29:20 +08:00
David Chang
82e3353f65 ver Dec25th 
added cache and upload function for setup
 2023-12-25 14:40:30 +08:00
Timothyxxx
236fcb0938 Refactor examples; Start to load examples into benchmark; vlc initialization 2023-12-25 00:24:13 +08:00
David Chang
295d09f1b2 ver Dec21stv2 
updated usage of tmp and cache direcotories
added cache function for evaluation resources acquiring
 2023-12-21 16:12:32 +08:00
David Chang
4a643abc31 ver Dec21st 
updated setup configs from dict-style to list-style to support more
flexible setup steps
 2023-12-21 10:30:23 +08:00
tsuky_chen
c628a4e0e8 debug dragTo 2023-12-13 00:05:43 +08:00
Timothyxxx
2ca36109b5 Initialize evaluation protocols and examples; Implement one kind of eval; Update requirements 2023-12-12 18:10:55 +08:00
Timothyxxx
343b40ecac Fix action_space setup 2023-12-06 22:59:19 +08:00
Timothyxxx
4ba053998d Improve the logic of env setup; add change wallpaper; add example 2023-12-05 17:32:24 +08:00
Timothyxxx
a5dd4408fe Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	main.py
 2023-12-05 11:48:30 +08:00
Timothyxxx
8818779329 Update compressor for data annotation 2023-12-04 00:51:33 +08:00
Jing Hua
e808cf84a7 setup controller 2023-12-03 21:09:05 +08:00
Timothyxxx
9471de4768 Fix the implementation of action 13 of computer 2023-12-03 00:59:02 +08:00
Timothyxxx
487fb8005b Improve: fix bugs; add back the cursor in screenshot; add pause in env.step 2023-12-02 22:14:50 +08:00
Timothyxxx
9b214b3d23 Action space thoughts 2023-12-02 18:02:06 +08:00
Timothyxxx
992d8f8fce Refactor with pyautogui 2023-12-02 17:52:00 +08:00
Jing Hua
3aebeffec3 add desktop get mouse pos 2023-11-30 17:37:04 +08:00
Jing Hua
ebb5f1cbc5 add mouse cursor to screenshot 2023-11-30 17:31:46 +08:00
Timothyxxx
3d0d9d7758 Run through gpt_4v agent pipeline 2023-11-29 20:21:57 +08:00
Timothyxxx
8c0525c20e Adapt for Windows os; Refine README 2023-11-27 00:29:09 +08:00
Jing Hua
6dee58252e add key down key up 2023-11-26 23:54:43 +08:00
Jing Hua
a8aebf5d15 mouse and keyboard controllers for windows and linux 2023-11-08 09:22:43 +08:00
Jing Hua
fd3787ee28 controllers 2023-11-02 11:10:55 +08:00