爬蟲之爬取小說
展示
源碼地址
https://github.com/Liar0320/spider
依賴
- cherrio Fast, flexible & lean implementation of core jQuery designed specifically for the server.
- inquirer A collection of common interactive command line user interfaces.
安裝
Clone the repo using Git:
git clone https://github.com/Liar0320/spider.git
Alternatively you can download this repository and then:
npm i
npm run start
配置參數
請求的超時時間
Timeout for each request.
default value: 15000
最大同時下載多少章節
The maximum number of threads that exist at one time, that is, the number of asynchronous downloads that are started at the same time.
default value: 20
請求失敗時，重新發起請求的次數
The number of times the request was re initiated if there was a request failure.
default value: 4
下載的目錄
Root of download directory
default value: join(__dirname, ‘./download’)