17 lines
674 B
Markdown
17 lines
674 B
Markdown
# Scraping data from Archives of Nethys
|
|
|
|
|
|
## How to scrape all creatures
|
|
|
|
1. Use firefox
|
|
2. Go to about:config and raise `devtools.netmonitor.responseBodyLimit` to the max
|
|
3. Open network dev tools
|
|
4. Visit https://2e.aonprd.com/Creatures.aspx
|
|
5. Scroll down and click the button to load all
|
|
6. In dev tools, click cogwheel, export HAR file.
|
|
|
|
|
|
let jsons = (open '2e.aonprd.com_Archive [26-05-08 21-11-24].har' | from json | get log.entries.response | where headers.value has "application/json" | get content.text)
|
|
|
|
⤷open '2e.aonprd.com_Archive [26-05-08 21-11-24].har' | from json | get log.entries.response | where headers.value has "application/json" | get content.text
|