Commit Graph

489 Commits

Author SHA1 Message Date
Eric Patey
bf3f054564 Fix crash caused by referencing an unbound local variable. (#128)
Co-authored-by: Eric Patey <>
2025-02-07 23:31:53 +08:00
Eric Patey
3ee6c34a36 Fix referenced before assignment regression introduced with #121. (#125)
Co-authored-by: Eric Patey <>
2025-02-05 10:51:59 +08:00
MillanK
983283a86a patch: minor bug fixes for evaluator and task configurations, documentation update (#121)
* fix: /cursor_position api return format fix

* chore: update README.md to remove deprecated command

* fix: add base score for evaluators and minor bug fixes

* fix: add base score for setup configurations

---------

Co-authored-by: Jiaqi Deng <jiaqideng@Jiaqis-MacBook-Pro.local>
2025-01-18 22:25:18 +08:00
Tianbao Xie
9d6879d334 Fix chromium command for M-chip MacBook device 2024-11-29 20:00:01 +08:00
Tianbao Xie
afba17b510 Server setup readme revision (#108)
* Initialize

* add note for resolution

* Organize

* draft version and todos

* ver Nov24th

supplemented socat installation and switching off automatic suspend and
  screen-off

* Finish Tianbao todos

* Finish Tianbao todos

* Fix typos

* update font install

* Finish Xiaochuan's Part

* Finish Xiaochuan's Part update

* Update README.md

* Fix format

---------

Co-authored-by: zdy023 <zdy004007@126.com>
Co-authored-by: tsuky_chen <3107760494@qq.com>
Co-authored-by: Jason Lee <lixiaochuan20@gmail.com>
Co-authored-by: Siheng Zhao <77528902+sihengz02@users.noreply.github.com>
2024-11-25 16:30:59 +08:00
Junli Wang
1503eb3994 Finish Aguvis eval on OSWorld (#107)
* Initialize Aguvis eval on OSWorld

* Debug

* Debug

* v1, internal version

* Add experiments script

* Fix minor bugs

* Update new endpoint

* Update ip

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix model name

* Fix docker close issues; update prompting

* Fix missed

* Fix the default port to avoid crashing on examples like '_update_browse_history_setup'

* Fix server and chromium ports in setup

* Revert and add missed dependency

* Add VLC port for docker

* Update

* Aguvis Grounding

* Add Aguvis as planner

* fix parse bug

* fix pause

* fix planner prompt

* Aguvis Grounding

* fix

* fix

* fix

* add logger for each example

* Modify Aguvis Planner Prompts

* fix logger setup

* fix absolute coordinates

* Finish Aguvis Evaluation on OSWorld

* Merge origin/main into junli/aguvis

* Remove screenshot

---------

Co-authored-by: Tianbao Xie <tianbaoxie@U-492FC39R-0217.local>
Co-authored-by: Timothyxxx <384084775@qq.com>
Co-authored-by: FredWuCZ <fredwucz@outlook.com>
2024-11-24 16:43:25 +08:00
Tianbao Xie
7d84a21962 Fix minor problems when aggragating the results (#106) 2024-11-22 17:37:34 +08:00
MillanK
98f437613d chore: update amazon ami id (#101) 2024-11-12 16:46:46 +08:00
Tianbao Xie
20442244fa [Feature] Initialize and Implement Aguvis Evaluation on OSWorld (#98)
* Initialize Aguvis eval on OSWorld

* Debug

* Debug

* v1, internal version

* Add experiments script

* Fix minor bugs

* Update new endpoint

* Update ip

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Update

* Fix model name

* Fix docker close issues; update prompting

* Fix missed

* Fix the default port to avoid crashing on examples like '_update_browse_history_setup'

* Fix server and chromium ports in setup

* Revert and add missed dependency

* Add VLC port for docker

* Update

* Clean

---------

Co-authored-by: Tianbao Xie <tianbaoxie@U-492FC39R-0217.local>
Co-authored-by: FredWuCZ <fredwucz@outlook.com>
2024-11-11 12:36:16 +08:00
Pierre Carrier
b35dc40ff4 SetupController: no server_port for chrome (#96) 2024-11-07 00:33:03 +08:00
Pierre Carrier
1754f195b0 fix(server): run on non-Windows python (#94) 2024-11-06 15:18:13 +08:00
Timothyxxx
5bc48e57d5 Clean on multi_env feat 2024-11-03 10:33:04 +08:00
Dunjie Lu
8be2a40967 Docker (#92)
* multi_env

* multi_env

---------

Co-authored-by: Timothyxxx <384084775@qq.com>
2024-11-02 22:28:23 +08:00
Timothyxxx
3933e0d303 fix(docker): add file lock for port allocation to prevent race conditions 2024-11-02 14:12:57 +08:00
HappySix
900b511422 Add os_type param to VBox manager (#85) 2024-10-25 14:46:09 +08:00
Pierre Carrier
924e0fcd17 metrics: fix time regex (#81) 2024-10-24 22:45:42 +08:00
FredWuCZ
05b317f151 Fix minor error on docs 2024-10-23 09:02:12 +08:00
FredWuCZ
954a78be36 Update Docker guidelines 2024-10-22 22:37:46 +08:00
FredWuCZ
278fe6b7c9 Merge Docker guidelines into Readme 2024-10-22 22:34:40 +08:00
Tianbao Xie
275de550b4 Set the default setting back to vmware and Ubuntu, since people may would try from desktop first 2024-10-22 22:31:42 +08:00
FredWuCZ
6635e8f3fd Minor update on docs 2024-10-22 20:47:39 +08:00
FredWuCZ
e9dbc3c374 Update docs 2024-10-22 20:42:27 +08:00
FredWuCZ
82878c885c Update Ubuntu qcow2 link 2024-10-18 20:17:49 +08:00
FredWuCZ
b46b6f0649 Clean up 2024-10-18 18:47:10 +08:00
FredWuCZ
9e86f160e7 Capture cursor on Windows 2024-10-18 18:44:53 +08:00
FredWuCZ
7eaa4189ae Fix unzip 2024-10-17 19:15:37 +08:00
FredWuCZ
ec3671ae01 Update Docker image link 2024-10-17 14:55:20 +08:00
FredWuCZ
6e75e37eb0 Enable Windows VM in Docker 2024-10-17 13:05:29 +08:00
FredWuCZ
3cba868ff3 Update 2024-10-08 17:59:06 +08:00
FredWuCZ
b9339217ef Update 2024-10-03 16:09:12 +08:00
FredWuCZ
fd65cf47f6 Update Windows URL 2024-10-02 12:19:01 +08:00
FredWuCZ
0a21e24a81 Update provider 2024-09-28 16:57:58 +08:00
FredWuCZ
2b4b6d8fdf Update 2024-09-28 15:07:56 +08:00
FredWuCZ
d0b37f0831 Update 2024-09-28 12:49:29 +08:00
FredWuCZ
5552ac9dcf Update docker manager & provider 2024-09-28 10:40:27 +08:00
FredWuCZ
da18f2f6e9 Add stop container 2024-09-27 13:22:57 +08:00
FredWuCZ
6498b2771b Update VM download link 2024-09-27 11:07:54 +08:00
FredWuCZ
7c64b62735 Add docker provider framework 2024-09-27 11:03:21 +08:00
MillanK
3b94cb4b74 chore: clean code and fix the default vmware directory (#74)
* feat: allow windows virtual mmachine

* chore: clean code and fix the default vmware directory

* chore: clean code and fix the default vmware directory
2024-09-24 14:18:47 +08:00
MillanK
c2f68b9085 feat: allow windows virtual mmachine (#73) 2024-09-24 00:08:13 +08:00
Timothyxxx
50a887ebb6 Fix the get terminal output error caused by namespace parameter changes 2024-08-23 16:12:27 +08:00
Timothyxxx
a8a60bd9d1 Fix minor bug in vm auto installing 2024-08-04 23:06:39 +08:00
Timothyxxx
df231889c9 Fix minor bug 2024-08-04 11:35:44 +08:00
Junli Wang
9ee006226e Improve accessibility functionality (#64)
* Initial commit

* fetching accessibility of dock
2024-08-02 17:39:21 +08:00
HappySix
a961d2276d Improve efficiency of getting accessibility tree (#57)
* Initial commit

* Accelarate a11y tree acquisition

* Clean code

* Leave todos for Windows and macOS

* Prepare for support of win and macos

* Prepare for support of win and macos

* Minor fix

* add preliminary support for macos

* fix subtle bugs

* Clean the windows a11y tree getter code

* Clean the windows a11y tree getter code

* Intermediate version

* Intermediate version

* Update

* adding support for macos

* Delete dummy

* Delete dummy

* add bounding box for pruning

* Delete dummy

* FIX: enable a11y tree fetching on Windows

* Move the requirement depency item place

* FIX: remove "jsonify" from return value of get a11y tree

* FIX: change print into logger, decompose functions in _create_pywinauto_node

* Update

* remove redundant nodes on macos

* remove reliance of pywinauto

* Clean

* Fix bugs for pywinauto a11y_tree acquisition

* FEAT: only fetch active windows, skip repeated nodes

* CHORE: clean code, add comments on time-consuming part, add connection logger.info

* FEAT: 1. add attrs including class_name, id, count... 2. use multithread to accelerate

* FIX: add code of getting writable properties

* Clean, update the max_depth for macOS

* FIX: get all active windows

* Accelarate child nodes in macOS

* FEAT: get all active windows, add timing when testing

* CHORE: remove print

* Clean and finalize

* Clean and finalize

---------

Co-authored-by: Timothyxxx <384084775@qq.com>
Co-authored-by: Junli Wang <ltnsxdxd@gmail.com>
Co-authored-by: YangJL2003 <yangjl22@mails.tsinghua.edu.cn>
2024-07-30 14:07:29 +08:00
Tianbao Xie
a156f8a3d6 Modify the namespace of a11y tree (#62) 2024-07-25 20:20:34 +08:00
Timothyxxx
284a5cf2db Clean deprecated assets 2024-07-14 15:37:36 +08:00
tsuky_chen
020ca667d2 Merge branch 'main' of https://github.com/xlang-ai/OSWorld 2024-07-11 21:23:01 +08:00
tsuky_chen
de78559144 fix vmware 2024-07-11 21:22:45 +08:00
Tianbao Xie
3b0d219e15 Update AWS_GUIDELINE.md 2024-07-11 10:21:15 +08:00