Initial commit
This commit is contained in:
16
README.md
Normal file
16
README.md
Normal file
@@ -0,0 +1,16 @@
|
||||
# Scraping data from Archives of Nethys
|
||||
|
||||
|
||||
## How to scrape all creatures
|
||||
|
||||
1. Use firefox
|
||||
2. Go to about:config and raise `devtools.netmonitor.responseBodyLimit` to the max
|
||||
3. Open network dev tools
|
||||
4. Visit https://2e.aonprd.com/Creatures.aspx
|
||||
5. Scroll down and click the button to load all
|
||||
6. In dev tools, click cogwheel, export HAR file.
|
||||
|
||||
|
||||
let jsons = (open '2e.aonprd.com_Archive [26-05-08 21-11-24].har' | from json | get log.entries.response | where headers.value has "application/json" | get content.text)
|
||||
|
||||
⤷open '2e.aonprd.com_Archive [26-05-08 21-11-24].har' | from json | get log.entries.response | where headers.value has "application/json" | get content.text
|
||||
Reference in New Issue
Block a user