sci-gui-agent-benchmark/data_preparation at c4bd76b78e9bedd2cf7e266f09130d4e92812e75 - sci-gui-agent-benchmark - Git of MAIC

lzy/sci-gui-agent-benchmark

Files

History

Timothyxxx fa84b20ea5 VLC updates, and some infra bugs fix

2024-01-09 09:30:11 +08:00

..

__init__.py

Add the GUI set-of-mark object detector data collection script

2024-01-05 11:00:31 +08:00

get_tag_elem_dict.js

Add the GUI set-of-mark object detector data collection script

2024-01-05 11:00:31 +08:00

majestic_million_download.py

Add the GUI set-of-mark object detector data collection script

2024-01-05 11:00:31 +08:00

README.md

Add the GUI set-of-mark object detector data collection script

2024-01-05 11:00:31 +08:00

scrape_crawler.py

VLC updates, and some infra bugs fix

2024-01-09 09:30:11 +08:00

README.md

Get the URLs from majestic_million and save them to majestic_million.csv

python3 majestic_million.py

Run scrapy spider to get the data from the URLs

python scrapy_crawler.py