1.12.9 • Published 8 months ago
twspace-crawler v1.12.9
twspace-crawler
Node.js script & command-line app to automatically monitor & download Twitter Spaces.
UPDATE 2023-07-01: SINCE TWITTER CHANGED THEIR APIS, READ INSTALLATION FIRST
Contents
Requirements
Installation
Command-line installation
npm install --global twspace-crawler
Module installation
npm install twspace-crawler
Usage
Monitor user(s) indefinitely, wait for live Space and download when Space ended
twspace-crawler --user nakiriayame,LaplusDarknesss
twspace-crawler --env ./.env --config ./config.json
Monitor & download Space by id
twspace-crawler --id 1yoJMWvbybNKQ
Download Space by playlist url
twspace-crawler --url https://prod-fastly-ap-northeast-1.video.pscp.tv/Transcoding/v1/hls/1Nq1QFkYTQ4v1X4BTV_aJ_pFeQhYyuYXY7ykz5xB7v5NvGwFMJMKwnRBmxyi9twF4BZ90ZKks5wdGKqESVsjLw...
Download Space by playlist url with additional metadata (if Space url still available)
twspace-crawler --id 1yoJMWvbybNKQ --url https://prod-fastly-ap-northeast-1.video.pscp.tv/Transcoding/v1/hls/1Nq1QFkYTQ4v1X4BTV_aJ_pFeQhYyuYXY7ykz5xB7v5NvGwFMJMKwnRBmxyi9twF4BZ90ZKks5wdGKqESVsjLw...
Options
General options
-h, --help Display help
-d, --debug Show debug logs
One-time download options
--id <SPACE_ID> Monitor & download live Space with its id
-surl, --space-url <SPACE_URL> Monitor & download live Space with its URL
--force Force download Space when using with --id
--url <PLAYLIST_URL> Download Space using playlist url
User monitoring options
--env <ENV_PATH> Path to .env file, default to current working
folder (See .env.example)
--config <CONFIG_PATH> Path to config file (See config.example.json)
--user <USER> Monitor & download live Spaces from users
indefinitely, separate by comma (,)
Additional options
--notification Show notification about new live Space
--force-open Force open Space in browser
Commands
Use to manually process audio/captions
List
- cc
download|d <SPACE_ID> <ENDPOINT> <TOKEN> Download Space captions, with
- ENDPOINT: Chat endpoint
- TOKEN: Chat access token
extract|e <FILE> [STARTED_AT] Extract Space captions
Example
twspace-crawler cc d 1yoJMWneoZwKQ https://prod-chatman-ancillary-ap-northeast-1.pscp.tv 2Ozpcu2xxqb5wxMdkyodUCygOrbYMLv8rq...
twspace-crawler cc e /download/sample_cc.jsonl
twspace-crawler cc e /download/sample_cc.jsonl 1633612289669
Webhooks
Currently support Discord Webooks
Check config.example.yaml or config.example.json for more detail
1.12.3
10 months ago
1.12.2
10 months ago
1.12.1
11 months ago
1.12.0
11 months ago
1.12.7
10 months ago
1.12.6
10 months ago
1.12.5
10 months ago
1.12.4
10 months ago
1.12.9
8 months ago
1.12.8
9 months ago
1.11.13
1 year ago
1.11.11
1 year ago
1.11.10
2 years ago
1.11.9
2 years ago
1.11.4
2 years ago
1.11.8
2 years ago
1.11.7
2 years ago
1.11.6
2 years ago
1.11.5
2 years ago
1.11.3
2 years ago
1.11.2
2 years ago
1.11.1
2 years ago
1.11.0
2 years ago
1.10.0
2 years ago
1.9.0
2 years ago
1.8.10
2 years ago