Timothyxxx 186bf2e97c Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

..

accessibility_tree_wrap

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

configs

pass test case

2024-01-02 01:10:46 +08:00

gui_som

VLC updates, and some infra bugs fix

2024-01-09 09:30:11 +08:00

ops

pass test case

2024-01-02 01:10:46 +08:00

task_adapter

update SoM_agent

2023-12-31 19:13:17 +08:00

__init__.py

Add DuckTrack as initial annotation tool; Initial multimodal test

2023-11-27 00:34:57 +08:00

desktop.png

pass test case

2024-01-02 01:10:46 +08:00

download_ckpt.sh

pass test case

2024-01-02 01:10:46 +08:00

gemini_pro_agent.py

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

gemini_pro_vision_agent.py

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

gpt_4_agent.py

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

gpt_4_prompt_action.py

Minor updates

2024-01-16 12:15:21 +08:00

gpt_4_prompt_code.py

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

gpt_4v_agent.py

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

gpt_4v_prompt_action.py

Add gemini agent implementation; Add missed requirements; Minor fix some small bugs

2024-01-15 21:58:33 +08:00

gpt_4v_prompt_code.py

Implement heuristic cutting on the accessibility tree to get the important nodes; Finish accessibility tree text agent

2024-01-16 16:43:32 +08:00

sam_test.py

Initialize visual components such as SAM for assistance

2023-11-29 20:22:48 +08:00

SoM_agent.py

pass test case

2024-01-02 01:10:46 +08:00