Merge branch 'main' of github.com:ztjhz/DesktopEnv

This commit is contained in:
David Chang
2024-04-24 13:09:16 +08:00
3 changed files with 13 additions and 3 deletions

View File

@@ -115,6 +115,12 @@ You will see all the logs of the system running normally, including the successf
## 🧪 Experiments ## 🧪 Experiments
### Agent Baselines ### Agent Baselines
If you wish to run the baseline agent used in our paper, you can execute the following command as an example under the GPT-4V pure-screenshot setting: If you wish to run the baseline agent used in our paper, you can execute the following command as an example under the GPT-4V pure-screenshot setting:
Set **OPENAI_API_KEY** environment variable with your API key
```bash
export OPENAI_API_KEY='changme'
```
```bash ```bash
python run.py --path_to_vm Ubuntu/Ubuntu.vmx --headless --observation_type screenshot --model gpt-4-vision-preview --result_dir ./results python run.py --path_to_vm Ubuntu/Ubuntu.vmx --headless --observation_type screenshot --model gpt-4-vision-preview --result_dir ./results
``` ```

View File

@@ -24,6 +24,7 @@ If you are interested in contributing to the project, please check the [CONTRIBU
- [ ] VPN setup doc for those who need it - [ ] VPN setup doc for those who need it
- [ ] Support running on platforms that have nested virtualization, e.g. Google Cloud, AWS, etc. - [ ] Support running on platforms that have nested virtualization, e.g. Google Cloud, AWS, etc.
- [ ] Prepare for the first release of Windows vm image for the environment - [ ] Prepare for the first release of Windows vm image for the environment
- [ ] Be able to run without virtual machine platform VMware
## Road Map of Annotation Tool ## Road Map of Annotation Tool

View File

@@ -189,9 +189,12 @@ def _install_virtual_machine(vm_name, working_dir="./vm_data", downloaded_file_n
os.makedirs(working_dir, exist_ok=True) os.makedirs(working_dir, exist_ok=True)
def __download_and_unzip_vm(): def __download_and_unzip_vm():
# Determine the platform and CPU architecture to decide the correct VM image to download # Determine the platform and CPU architecture to decide the correct VM image to download
if platform.machine() == 'arm64': # macOS with Apple Silicon if platform.system() == 'Darwin': # macOS
url = UBUNTU_ARM_URL if os.uname().machine == 'arm64': # Apple Silicon
elif platform.machine().lower() in ['amd64', "x86_64"]: url = UBUNTU_ARM_URL
else:
url = UBUNTU_X86_URL
elif platform.machine().lower() in ['amd64', 'x86_64']:
url = UBUNTU_X86_URL url = UBUNTU_X86_URL
else: else:
raise Exception("Unsupported platform or architecture") raise Exception("Unsupported platform or architecture")