Add the GUI set-of-mark object detector data collection script
This commit is contained in:
8
mm_agents/gui_som/data_preparation/README.md
Normal file
8
mm_agents/gui_som/data_preparation/README.md
Normal file
@@ -0,0 +1,8 @@
|
||||
1. Get the URLs from majestic_million and save them to `majestic_million.csv`
|
||||
```bash
|
||||
python3 majestic_million.py
|
||||
```
|
||||
2. Run scrapy spider to get the data from the URLs
|
||||
```bash
|
||||
python scrapy_crawler.py
|
||||
```
|
||||
Reference in New Issue
Block a user