lzy/sci-gui-agent-benchmark
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: 新增科研软件 benchmark 任务数据

Browse Source 
- 新增 avogadro/imagej/jade/origin/ovito/pymol/vesta 等科研软件任务 JSON
- 修改 vllm_eval.py，修改图片文件名称为第x步
- desktop_env.py 添加额外数据参数 config 和 metadata
This commit is contained in:
lizhanyuan
2026-02-25 15:19:36 +08:00
parent 613f55f0da
commit 9899d4a0c7
85 changed files with 4703 additions and 71 deletions
Download Patch File Download Diff File Expand all files Collapse all files

44
evaluation_examples/examples/pymol/MovieSchool_1_task1.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_1_task1",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过命令行制作一个简单动画，播放 NMR ensemble。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 在 PyMOL 命令行中输入 `fetch 1nmr` 来加载 NMR ensemble。\n2. 输入 `mplay` 命令开始播放动画。\n3. 如果需要停止播放动画，输入 `mstop` 。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_1_task2.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_1_task2",
"snapshot": "pymol",
"instruction": "在 PyMOL 中制作一个场景绕 Y 轴 360 度旋转的动画。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 从菜单中选择适当选项，用于创建场景绕 Y 轴旋转的动画。\n2. 按下“Pressplay”开始播放动画。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_1_task3.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_1_task3",
"snapshot": "pymol",
"instruction": "在 PyMOL 中制作场景摇摆动画，可选择 30, 60, 90, 120 或 180 度摇摆角度。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 从菜单中选择用于设置场景摇摆动画的选项。\n2. 选择摇摆角度（例如 30、60、90、120 或 180 度）。\n3. 按下“Pressplay”启动动画。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_1_task4.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_1_task4",
"snapshot": "pymol",
"instruction": "在 PyMOL 中制作一个简单的场景“摇摆（Nutate）”动画。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 从菜单中选择制作摇摆动画的选项。\n2. 设置摇摆效果参数。\n3. 按下“Pressplay”启动摇摆动画。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_1_task5.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_1_task5",
"snapshot": "pymol",
"instruction": "在 PyMOL 中使用 Scene Loop 制作一个从原子缩放并返回的动画。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 创建一个场景并设置为缩放到特定原子。\n2. 保存该场景。\n3. 使用 PyMOL 中的 Scene Loop 功能连接多个保存的场景。\n4. 播放动画以观察缩放效果。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_3_task1.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_3_task1",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 Movie 菜单添加 2 秒到当前视频的尾部。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 点击菜单栏中的 Movie。\n2. 从下拉菜单中选择 Append。\n3. 在 Append 子菜单中选择 2 seconds。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_3_task10.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_3_task10",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 ALA Motions 菜单查看 ALA fragment 的运动选项。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 在 PyMOL 的底部工具栏上点击 All。\n2. 从下拉菜单中选择 ALA。\n3. 在 ALA 菜单中选择 Motions。\n4. 浏览显示的运动/位置选项。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_3_task2.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_3_task2",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 Movie 菜单设置视频帧率为 15 FPS。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 点击菜单栏中的 Movie。\n2. 从下拉菜单中选择 Frame Rate。\n3. 在 Frame Rate 子菜单中选择 15 FPS。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_3_task3.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_3_task3",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 Scene 菜单将当前场景存储为名称 'my_scene'。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 点击菜单栏中的 Scene。\n2. 从下拉菜单中选择 Store。\n3. 在弹出的窗口中输入 'my_scene' 作为场景名称。\n4. 点击确认按钮存储场景。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_3_task4.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_3_task4",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 Scene 菜单清除所有存储的场景。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 点击菜单栏中的 Scene。\n2. 从下拉菜单中选择 Clear。\n3. 在确认对话框中点击是以清除所有场景。"
}
}

44
evaluation_examples/examples/pymol/MovieSchool_3_task5.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "MovieSchool_3_task5",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 Mouse 菜单将鼠标模式设置为 3 Button Motions。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 点击菜单栏中的 Mouse。\n2. 从下拉菜单中选择 Edit。\n3. 在 Edit 菜单中选择 Motions。\n4. 在弹出的子菜单中选择 3 Button Motions。"
}
}

44
evaluation_examples/examples/pymol/Mutagenesis_task4.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "Mutagenesis_task4",
"snapshot": "pymol",
"instruction": "解释 PyMOL Mutagenesis 工具中的颜色代码，以理解范德瓦尔斯半径重叠情况。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 打开 PyMOL 软件并加载任意结构。\n2. 通过 Wizard → Mutagenesis 打开 Mutagenesis 工具。\n3. 查看 Mutagenesis 工具中指定区域的颜色提示。\n4. 确认颜色解释：绿色表示轻微重叠，红色表示显著重叠。\n5. 使用颜色信息选择适当的操作来优化结构。"
}
}

44
evaluation_examples/examples/pymol/Practical_Pymol_for_Beginners_task6.json Normal file
View File

@@ -0,0 +1,44 @@
{
"id": "Practical_Pymol_for_Beginners_task6",
"snapshot": "pymol",
"instruction": "在 PyMOL 中，通过 File → Save Session 保存当前会话为 .pse 文件。",
"source": "custom",
"config": [
{
"type": "launch",
"parameters": {
"command": [
"C:\\PYMOL\\PyMOLWin.exe"
]
}
},
{
"type": "sleep",
"parameters": {
"seconds": 5
}
}
],
"trajectory": "trajectories/",
"related_apps": [
"pymol"
],
"evaluator": {
"postconfig": [
{
"type": "sleep",
"parameters": {
"seconds": 3
}
}
],
"func": "vllm_eval"
},
"proxy": false,
"fixed_ip": false,
"possibility_of_env_change": "low",
"metadata": {
"input_files": [],
"steps": "1. 确保所有需要的对象和场景已设置好。\n2. 点击菜单栏 File → Save Session。\n3. 在弹出的窗口中命名文件并保存为 .pse 格式。\n4. 确认会话被成功保存。"
}
}