lzy/sci-gui-agent-benchmark
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
949 Commits 3 Branches 0 Tags
f4750701d41367c8dc3ef604c9e572dec9a4291d
Commit Graph

53 Commits

Author SHA1 Message Date
HappySix
6419d707bc Support Docker VM manager and provider (#75) 
* Add docker provider framework

* Update VM download link

* Add stop container

* Update docker manager & provider

* Update

* Update

* Update provider
 2024-09-28 21:10:40 +08:00
HappySix
16c3defe20 Change resolution before saving snapshot in VirtualBox (#47) 
* Initailize aws support

* Add README for the VM server

* Refactor OSWorld for supporting more cloud services.

* Initialize vmware and aws implementation v1, waiting for verification

* Initlize files for azure, gcp and virtualbox support

* Debug on the VMware provider

* Fix on aws interface mapping

* Fix instance type

* Refactor

* Clean

* Add Azure provider

* hk region; debug

* Fix lock

* Remove print

* Remove key_name requirements when allocating aws vm

* Clean README

* Fix reset

* Fix bugs

* Add VirtualBox and Azure providers

* Add VirtualBox OVF link

* Raise exception on macOS host

* Init RAEDME for VBox

* Update VirtualBox VM download link

* Update requirements and setup.py; Improve robustness on Windows

* Fix network adapter

* Go through on Windows machine

* Add default adapter option

* Fix minor error

* Change resolution before creating snapshot

* Fix small error

* Change default provider option

---------

Co-authored-by: Timothyxxx <384084775@qq.com>
Co-authored-by: XinyuanWangCS <xywang626@gmail.com>
Co-authored-by: Tianbao Xie <47296835+Timothyxxx@users.noreply.github.com>
 2024-06-20 19:03:13 +08:00
HappySix
19106467f8 VirtualBox (#46) 
* Initailize aws support

* Add README for the VM server

* Refactor OSWorld for supporting more cloud services.

* Initialize vmware and aws implementation v1, waiting for verification

* Initlize files for azure, gcp and virtualbox support

* Debug on the VMware provider

* Fix on aws interface mapping

* Fix instance type

* Refactor

* Clean

* Add Azure provider

* hk region; debug

* Fix lock

* Remove print

* Remove key_name requirements when allocating aws vm

* Clean README

* Fix reset

* Fix bugs

* Add VirtualBox and Azure providers

* Add VirtualBox OVF link

* Raise exception on macOS host

* Init RAEDME for VBox

* Update VirtualBox VM download link

* Update requirements and setup.py; Improve robustness on Windows

* Fix network adapter

* Go through on Windows machine

* Add default adapter option

* Fix minor error

---------

Co-authored-by: Timothyxxx <384084775@qq.com>
Co-authored-by: XinyuanWangCS <xywang626@gmail.com>
Co-authored-by: Tianbao Xie <47296835+Timothyxxx@users.noreply.github.com>
 2024-06-17 22:46:04 +08:00
Tianbao Xie
fffa8f8da6 Refactoring VMware Integration and Implementing AWS Support (#44) 
* Initailize aws support

* Add README for the VM server

* Refactor OSWorld for supporting more cloud services.

* Initialize vmware and aws implementation v1, waiting for verification

* Initlize files for azure, gcp and virtualbox support

* Debug on the VMware provider

* Fix on aws interface mapping

* Fix instance type

* Refactor

* Clean

* hk region; debug

* Fix lock

* Remove print

* Remove key_name requirements when allocating aws vm

* Clean README

---------

Co-authored-by: XinyuanWangCS <xywang626@gmail.com>
 2024-06-15 20:52:29 +08:00
Timothyxxx
9c75df5dce Clean code; Refactor environment to pass screenshot content instead of path 2024-04-13 23:34:01 +08:00
David Chang
15e01e7ccc ver Mar20thv2 
fixed bugs in server/main.py (_create_pywinauto_node and
  get_screen_size)
finished migration of a few task configs to Windows
fixed bug in python.py
 2024-03-20 22:22:57 +08:00
rhythmcao
81580a1bbc fix incompatible errors in main.py (temporarily fixup, will be dropped in future after snapshot download is ok) 2024-03-15 22:09:24 +08:00
Timothyxxx
35ed7cec89 Update todos 2024-03-14 22:36:33 +08:00
rhythmcao
8b42d699af fix Desktop path error, revise main.py and update google writer tutorial 2024-02-06 21:45:03 +08:00
BlankCheng
7d2d8c855e Merge main 2024-01-29 21:51:26 +08:00
BlankCheng
284d6fb379 Add human operation time log 2024-01-29 21:42:16 +08:00
Timothyxxx
343813a29b Add impress examples; remove the auto-saving pyautogui commands change to libreoffice pre-setting 2024-01-29 21:34:58 +08:00
David Chang
4fbdcb56d2 Merge branch 'zdy' 2024-01-26 12:33:49 +08:00
tsuky_chen
3e7cfa8699 load libreoffice writer eval -batch 2 2024-01-26 02:07:26 +08:00
David Chang
19214f2107 ver Jan17thv2 
updated compare_table with compare the shown value through exported csv
 2024-01-17 22:43:26 +08:00
David Chang
fc289a3427 Merge branch 'main' into zdy 2024-01-15 12:12:05 +08:00
David Chang
b9d8e6c631 ver Jan15th 
attachment task of thunderbird
 2024-01-15 11:49:43 +08:00
David Chang
59fdd9f1a2 ver Jan14th 
setup method for Thunderbird composing tasks
 2024-01-14 23:16:54 +08:00
Timothyxxx
d52b692ee5 Finish loading the vscode examples v1; Improve on the infra: Add accessibility tree into the observation; Add activate window function, etc 2024-01-14 18:30:49 +08:00
David Chang
d4192d3d9c ver Jan12thv3 
debugged
 2024-01-13 00:06:11 +08:00
David Chang
3c04872dcf ver Jan11thv2 
a new Thunderbird example w.r.t. email filter
 2024-01-11 22:43:38 +08:00
David Chang
27eaf2f5d5 ver Jan11th 
finally set up a simple task, or which should be simple
 2024-01-11 20:03:33 +08:00
David Chang
1515b05666 ver Jan10thv2 
a new example config for Thunderbird
fixed several bugs
 2024-01-10 21:58:29 +08:00
David Chang
cf5d480f44 ver Jan10th 
new Thunderbird task config
 2024-01-10 17:36:59 +08:00
David Chang
eeb8a120d6 ver Jan5th 
debugged
 2024-01-05 15:20:47 +08:00
David Chang
ade9002da4 Merge branch 'main' into zdy 2023-12-25 20:29:20 +08:00
David Chang
82e3353f65 ver Dec25th 
added cache and upload function for setup
 2023-12-25 14:40:30 +08:00
Timothyxxx
236fcb0938 Refactor examples; Start to load examples into benchmark; vlc initialization 2023-12-25 00:24:13 +08:00
David Chang
4782b687b9 Merge branch 'zdy' 2023-12-22 15:23:56 +08:00
David Chang
fffc4aadca ver Dec22ndv3 
added function to switch tasks and reload the configs of setup &
evaluation
 2023-12-22 15:20:27 +08:00
David Chang
adef02dec8 ver Dec21stv3 
merged zdy to main
 2023-12-21 16:21:21 +08:00
David Chang
295d09f1b2 ver Dec21stv2 
updated usage of tmp and cache direcotories
added cache function for evaluation resources acquiring
 2023-12-21 16:12:32 +08:00
David Chang
de24fa91ba Merge branch 'zdy' 2023-12-21 10:42:18 +08:00
David Chang
f4949c3e90 ver Dec20th 
fixed bug caused by windows-only os.startfile
 2023-12-20 20:55:47 +08:00
David Chang
b37df609b9 ver Dec20th 
some adaptations to make in run on my device
 2023-12-20 20:14:39 +08:00
zdy023
b7267fac07 Merge branch 'main' into zdy 2023-12-19 11:06:17 +08:00
Timothyxxx
05d3b5863d Update the script on server for ubuntu 2023-12-18 19:53:22 +08:00
Timothyxxx
2ca36109b5 Initialize evaluation protocols and examples; Implement one kind of eval; Update requirements 2023-12-12 18:10:55 +08:00
Timothyxxx
343b40ecac Fix action_space setup 2023-12-06 22:59:19 +08:00
Timothyxxx
b9c317f0f5 Setup initial examples 2023-12-06 17:04:33 +08:00
Timothyxxx
4ba053998d Improve the logic of env setup; add change wallpaper; add example 2023-12-05 17:32:24 +08:00
Timothyxxx
a5dd4408fe Merge remote-tracking branch 'origin/main' 
# Conflicts:
#	main.py
 2023-12-05 11:48:30 +08:00
Timothyxxx
8818779329 Update compressor for data annotation 2023-12-04 00:51:33 +08:00
Jing Hua
e808cf84a7 setup controller 2023-12-03 21:09:05 +08:00
Jing Hua
58e9807a70 automate vm ip address 2023-12-03 17:17:25 +08:00
Timothyxxx
487fb8005b Improve: fix bugs; add back the cursor in screenshot; add pause in env.step 2023-12-02 22:14:50 +08:00
Timothyxxx
992d8f8fce Refactor with pyautogui 2023-12-02 17:52:00 +08:00
David Chang
857f73f61d ver Nov23rd 
trying to set up the environment
 2023-11-24 20:39:08 +08:00
Jing Hua
a8aebf5d15 mouse and keyboard controllers for windows and linux 2023-11-08 09:22:43 +08:00
Jing Hua
9620c75cf2 finish reset step 2023-11-02 12:09:36 +08:00