0.0.26 • Published 6 years ago
sooty v0.0.26
sooty
A bit of oofle dust to scrape websites
it useful ★ ★ ★
Features
- Scrape by query selector
- Built on headless chrome
Installation
npm install --save sooty
Dependencies
Usage
import Sooty from 'sooty';
const scrapper = new Sooty({
url: 'https://google.com', // go to google search page
interactions: {
search: [
{ // fill out Google search
fields: { q: 'funny cat videos' }
},
{ // press "Google Search" button
click: 'input[name=btnK]',
waitUntil: 'networkidle0'
}
]
},
queries: {
catVideos: { // query google search results
selector: '.rc .r a',
requires: ['search']
}
}
});
scrapper.run().then(results => {
results.catVideos.forEach(catVideo => {
console.log(`${catVideo}\n`);
});
});
Support
Submit an issue
Screenshots
Contribute a screenshot
Contributing
Review the guidelines for contributing
License
Jam Risser © 2018
Changelog
Review the changelog
Credits
- Jam Risser - Author
Support on Beerpay (actually, I drink coffee)
A ridiculous amount of coffee :coffee: :coffee: :coffee: was consumed in the process of building this project.
Add some fuel if you'd like to keep me going!
0.0.26
6 years ago
0.0.25
6 years ago
0.0.24
6 years ago
0.0.23
6 years ago
0.0.22
6 years ago
0.0.21
6 years ago
0.0.20
6 years ago
0.0.19
6 years ago
0.0.18
6 years ago
0.0.17
6 years ago
0.0.16
7 years ago
0.0.15
7 years ago
0.0.14
7 years ago
0.0.13
7 years ago
0.0.12
7 years ago
0.0.11
7 years ago
0.0.10
7 years ago
0.0.9
7 years ago
0.0.8
7 years ago
0.0.7
7 years ago
0.0.6
7 years ago
0.0.5
7 years ago
0.0.4
7 years ago
0.0.3
7 years ago
0.0.2
7 years ago
0.0.1
7 years ago
1.0.0
9 years ago