Add the GUI set-of-mark object detector data collection script

This commit is contained in:
Timothyxxx
2024-01-05 11:00:31 +08:00
parent 2401513c19
commit 3cbb57f24c
6 changed files with 324 additions and 0 deletions

View File

@@ -0,0 +1,8 @@
1. Get the URLs from majestic_million and save them to `majestic_million.csv`
```bash
python3 majestic_million.py
```
2. Run scrapy spider to get the data from the URLs
```bash
python scrapy_crawler.py
```