BlankCheng
|
284d6fb379
|
Add human operation time log
|
2024-01-29 21:42:16 +08:00 |
|
Timothyxxx
|
186bf2e97c
|
Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent
|
2024-01-16 16:43:32 +08:00 |
|
Timothyxxx
|
1141232d80
|
Merge remote-tracking branch 'origin/main'
# Conflicts:
# desktop_env/controllers/setup.py
|
2024-01-15 13:51:11 +08:00 |
|
Timothyxxx
|
24169a65d0
|
Accomplish the exp scripts v1; Add video recording and trajectory recording of desktop agent; Fix minor bugs
|
2024-01-15 13:49:48 +08:00 |
|
rhythmcao
|
69b0514f99
|
fix error in pyautogui.typewrite()
|
2024-01-14 23:53:31 +08:00 |
|
Timothyxxx
|
f153a4c253
|
Add 'WAIT', 'FAIL', 'DONE' to the action space; Debug basic prompting-based GPT-4 and Gemini agents; Initialize experiments script;
|
2024-01-14 23:36:19 +08:00 |
|
Timothyxxx
|
a1c3e4c294
|
Finish Chrome example loading v1
|
2024-01-13 22:56:50 +08:00 |
|
rhythmcao
|
d4116458ff
|
1. fix quote and \ characters in execute_command ; 2. add terminal output text as extra observation ; 3. move get_vm_*() to reset()
|
2024-01-12 18:09:05 +08:00 |
|
Timothyxxx
|
5a93a32958
|
Update on Chrome examples; Refactor on logic of controlling
|
2024-01-12 17:24:47 +08:00 |
|
Timothyxxx
|
820579a5a2
|
Make up missing getters and metrics; Update VLC scripts; Start to work on Chrome, update examples instructions
|
2024-01-11 21:27:40 +08:00 |
|
Timothyxxx
|
287876affc
|
Merge remote-tracking branch 'origin/main'
# Conflicts:
# desktop_env/evaluators/getters/__init__.py
# desktop_env/evaluators/metrics/__init__.py
# requirements.txt
|
2024-01-10 23:20:49 +08:00 |
|
Timothyxxx
|
49ece15ac3
|
VLC v1 finished, improve on instructions, improve on infra
|
2024-01-10 23:18:30 +08:00 |
|
David Chang
|
cebae4b183
|
Merge branch 'main' into zdy
|
2024-01-10 22:16:25 +08:00 |
|
David Chang
|
cf5d480f44
|
ver Jan10th
new Thunderbird task config
|
2024-01-10 17:36:59 +08:00 |
|
Timothyxxx
|
abcafce750
|
VLC updates, and some infra bugs fix
|
2024-01-09 23:14:06 +08:00 |
|
David Chang
|
26b7d9010d
|
Merge branch 'zdy'
|
2024-01-05 15:55:41 +08:00 |
|
David Chang
|
eeb8a120d6
|
ver Jan5th
debugged
|
2024-01-05 15:20:47 +08:00 |
|
Timothyxxx
|
ab71ebb2ba
|
Initialize VLC getters and metrics, fix some bugs in infra logic, needs to be refactored later on
|
2024-01-04 17:05:17 +08:00 |
|
tsuky_chen
|
c628a4e0e8
|
debug dragTo
|
2023-12-13 00:05:43 +08:00 |
|
Timothyxxx
|
2ca36109b5
|
Initialize evaluation protocols and examples; Implement one kind of eval; Update requirements
|
2023-12-12 18:10:55 +08:00 |
|
Timothyxxx
|
8818779329
|
Update compressor for data annotation
|
2023-12-04 00:51:33 +08:00 |
|
Timothyxxx
|
9471de4768
|
Fix the implementation of action 13 of computer
|
2023-12-03 00:59:02 +08:00 |
|
Timothyxxx
|
487fb8005b
|
Improve: fix bugs; add back the cursor in screenshot; add pause in env.step
|
2023-12-02 22:14:50 +08:00 |
|
Timothyxxx
|
9b214b3d23
|
Action space thoughts
|
2023-12-02 18:02:06 +08:00 |
|
Timothyxxx
|
992d8f8fce
|
Refactor with pyautogui
|
2023-12-02 17:52:00 +08:00 |
|
Jing Hua
|
ebb5f1cbc5
|
add mouse cursor to screenshot
|
2023-11-30 17:31:46 +08:00 |
|
Timothyxxx
|
3d0d9d7758
|
Run through gpt_4v agent pipeline
|
2023-11-29 20:21:57 +08:00 |
|
Jing Hua
|
a8aebf5d15
|
mouse and keyboard controllers for windows and linux
|
2023-11-08 09:22:43 +08:00 |
|