1.0.0 • Published 10 months ago

borrius_pokemon_scraper v1.0.0

Weekly downloads
-
License
MIT
Repository
github
Last release
10 months ago

Borrius Pokedex Scraper

Overview

A Web Scraper that extracts data from the Pokemon Unbound Pokedex website and outputs it to a JSON file.

  • Built with Python and BeautifulSoup, Based on a tutorial from RealPython
  • Contains data for the 503 Borrius Region Pokemon found in the Popular Romhack Pokemon Unbound
  • Unlike the Borrius Dex, this scraper contains the 3 Starter Pokemon (Larvitar, Metang, Gible). They're at the beginning of the Pokedex Data.

  • Data provided includes:

    • Number, Name and Types
    • Sprites
    • Catch Rate
    • Gender Ratio
    • Ability
    • Weight and Height (Metric and Imperial)
    • Stats (Min, Avg Max)
    • Learned Moves (Level, Move-name, Type, Category, Power, Accuracy)
    • TM/HM Moves ( Move-name, Type, Category, Power, Accuracy)

View Sample JSON here!

Instructions

Note: As the project is completed, the Pokedex is unlikely to have changed, so you may want ot download the JSON provided. Otherwise:

  1. Install Python dependancies from requirements.txt
  2. Download and extract the project by cloning this project or running the ZIP
  3. Run python borrius_pokemon_scraper.py in the terminal
  4. Wait for the process to completes (takes around >2 minutes)
  5. Open the borrius_pokedex_data.json file in your favorite text editor and enjoy

TO DO:

  • Scrape all pokemon
  • Extract Sprite Data from Site! (Not yet Implemented)
  • Print retrieved data into JSON
  • Save JSON to a file
  • Implement Error Messages for process
  • Make this available publically/for other projects

FUTURE FEATURES:

  • Download and store images for perpetuity in case i need to self host
  • Get real pokemon national number (extract from url, Recycling!)
  • speed up json generation
  • Implement starter pokemon data from Borrius National Dex (+9 more attached to start)
  • / Compile API
  • / Patch in missing data from PokeAPI
    • [] Line up data for use with Curadex project
    • [] Add back sprites from PokeApi
    • [] Handle movelists so they're not collosal lists for each pokemon
1.0.0

10 months ago