定時爬蟲示例

編寫一個腳本,將改腳本放置 爬蟲項目 同級目錄下

    具體代碼如下

import datetime
import time
from scrapy import cmdline
def spider():
    # 把爬蟲程序放在這個類裏 zhilian_spider 是爬蟲的name
    cmdline.execute('scrapy crawl zhilian_spider'.split())
# 想幾點更新,定時到幾點
def main(h=17, m=54):
    while True:
        now = datetime.datetime.now()
        # print(now.hour, now.minute)
        if now.hour == h and now.minute == m:
            spider()
        # 每隔60秒檢測一次
        time.sleep(60)
if __name__ == '__main__':
    main()