0.1.2 • Published 8 years ago

so-review v0.1.2

Weekly downloads
3
License
WTFPL
Repository
github
Last release
8 years ago

Stack Overflow Close Votes review scraper

This app scrapes the Close Votes review queue to get the list of all items in the queue. Currently there's only a userscript which displays a review link next to a question when it's in the CV queue, but I'm planning to make a web UI to display the list of questions and filter them by tags, amount of close votes, OP's reputation, etc.

How it works?

Obtaining items in the queue

In order to obtain the list of items that are currently in the queue, this app logs into Stack Overflow (required account with close votes privilege), enters the queue, scrapes information about current item and skips it. Then it scrapes information about the next next item, skips it and so on. When it reaches the end of the queue (i.e. when there are no items left), it waits 60 seconds, and checks if there are some items in the queue.

Checking if a review has been completed

In the /review page, there's a list of recent reviewers. It's updated in real-time through WebSockets. Anyone can access it, you don't even have to be logged in. This app connects to the WebSocket server, and when it gets information about recent reviewers, it scrapes their profiles to get their recent reviews. Then it scrapes again the review items, and if they have been completed, it updates database.

It also scrapes each review task manually once a day.

Author

This app is developed by Gothdo and that account is also used as the bot account.

If you want to contact me, write an email to michal AT perlakowski DOT pl.