From a3706004d011b1c256707374fe6c1212fce50a70 Mon Sep 17 00:00:00 2001 From: Jing Hua Date: Thu, 2 Nov 2023 09:44:02 +0800 Subject: [PATCH] update readme --- README.md | 17 ++++++++++------- 1 file changed, 10 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index b2230f6..e4072f2 100644 --- a/README.md +++ b/README.md @@ -3,16 +3,16 @@ ## Setup guide 1. Download OS image - 1. Download kubuntu from https://kubuntu.org/getkubuntu/ - 2. Download ubuntu from https://ubuntu.com/download/desktop - 1. If mac OS, use https://cdimage.ubuntu.com/jammy/daily-live/current/jammy-desktop-arm64.iso - 3. Download Windows, TODO - 4. Download MacOS, TODO + 1. Download kubuntu from + 2. Download ubuntu from + 1. If mac OS, use + 3. Download Windows from + 4. ~~Download MacOS~~ (Not possible to download legally) 2. Setup virtual machine 1. Create `Host Only Adapter` and add it to the network adapter in the settings 3. Set up bridge for connecting to VM 1. Option 1: Install [xdotool](https://github.com/jordansissel/xdotool) on VM - 2. Option 2: Install [mouse]() TODO + 2. Option 2: Install [mouse](https://github.com/boppreh/mouse/) 4. Set up SSH server on VM: https://averagelinuxuser.com/ssh-into-virtualbox/ 1. `sudo apt install openssh-server` 2. `sudo systemctl enable ssh --now` @@ -26,11 +26,14 @@ 6. Get screenshot 1. `scp user@192.168.7.128:~/screenshot.png screenshot.png` 2. `rm -rf ~/screenshot.png` +7. Set up python and install [mouse](https://github.com/boppreh/mouse/) and [keyboard](https://github.com/jordansissel/xdotool) ## Road map (Proposed) - [ ] Explore VMWare, and whether it can be connected and control through mouse package -- [ ] Explore Windows and MacOS, whether it can be installed +- [x] Explore Windows and MacOS, whether it can be installed + - MacOS is closed source and cannot be legally installed + - Windows is available legally and can be installed - [ ] Build gym-like python interface for controlling the VM - [ ] Recording of actions (mouse movement, click, keyboard) for human to annotate, and we can replay it - [ ] This part may be conflict with work from [Aran Komatsuzaki](https://twitter.com/arankomatsuzaki) team, a.k.a. [Duck AI](https://duckai.org/)