ver Feb2nd

human evaluation as non-expert on vlc

desktop_env/evaluators/README.md

@@ -191,7 +191,7 @@ To enable and use the HTTP interface in VLC Media Player for remote control and
 #### 4. Configure Lua HTTP
 
 - Expand the `Main interfaces` node and select `Lua`.
-- Under `Lua HTTP`, set a password in the `Lua HTTP` section. This password will be required to access the HTTP interface.
+- Under `Lua HTTP`, set a password `password` in the `Lua HTTP` section. This password will be required to access the HTTP interface.
 
 #### 5. Save and Restart VLC
 
@@ -217,4 +217,4 @@ pip install opencv-python-headless Pillow imagehash
 - If the port is in use by another application, you may change the port number in VLC's settings.
 
 ## GIMP
-Click on the "Keep" of the image loading pop-up.
+Click on the "Keep" of the image loading pop-up.

evaluation_examples/examples/vlc/8f080098-ddb1-424c-b438-4e96e5e4786e.json

@@ -1,7 +1,7 @@
 {
   "id": "8f080098-ddb1-424c-b438-4e96e5e4786e",
   "snapshot": "base_setup",
-  "instruction": "Could you download the song from this music video and save it as an MP3 file? I'd like to have it on my device to play whenever I want. Please title the file \"Baby Justin Bieber.mp3.\" I really appreciate your help!",
+  "instruction": "Could you download the song from this music video and save it as an MP3 file? I'd like to have it on my device to play whenever I want. Please save the file just on the desktop and title the file \"Baby Justin Bieber.mp3.\" I really appreciate your help!",
   "source": "https://medium.com/@jetscribe_ai/how-to-extract-mp3-audio-from-videos-using-vlc-media-player-beeef644ebfb",
   "config": [
     {

main.py

@@ -47,9 +47,9 @@ def human_agent():
     Runs the Gym environment with human input.
     """
 
-    with open("evaluation_examples/examples/chrome/af630914-714e-4a24-a7bb-f9af687d3b91.json", "r") as f:
+    with open("evaluation_examples/examples/vlc/215dfd39-f493-4bc3-a027-8a97d72c61bf.json", "r") as f:
         example = json.load(f)
-    example["snapshot"] = "Snapshot 35"
+    example["snapshot"] = "Snapshot 36"
 
     #env = DesktopEnv( path_to_vm="~/vmware/Windows 10 x64/Windows 10 x64.vmx"
     env = DesktopEnv( path_to_vm="/mnt/data1/david/os-images/Ubuntu-1218/Ubuntu.vmx"