Web Scraping and Data Mining for GMs, Part 1

Web Scraping and Data Mining for GMs, Part 1 A Brief Introduction I'm planning on running an AD&D 2nd edition campaign, and I'd like to be able to programatically access information about monsters in my world. TSR released a bunch of monsters for 2nd edition in their Monstrous Compendium series. I own most of these books in pdf, and could theoretically grab all the monsters information from those PDFs, but there is an easier way. These days, web scraping is an essential skill for programmers, and sometimes, for Game Masters. If, like me, you're a GM with some basic programming skill, you can scrape a lot of useful data. At one time, lomion.de was where you went if you wanted to see AD&D 2nd edition monster information online. Unfortunately, that site is no longer in existence. Enter The Wayback Machine : a project by archive.org to make older websites accessible. They have an archive of lomion.de , and a very liberal scraping p...