scraoy 命令

官方文檔

scrapy   -h

  bench         Run quick benchmark test
  check         Check spider contracts
  commands
  crawl         Run a spider
  edit          Edit spider
  fetch         Fetch a URL using the Scrapy downloader
  genspider     Generate new spider using pre-defined templates
  list          List available spiders
  parse         Parse URL (using its spider) and print the results
  runspider     Run a self-contained spider (without creating a project)
  settings      Get settings values
  shell         Interactive scraping console
  startproject  Create new project
  version       Print Scrapy version
  view          Open URL in browser, as seen by Scrapy

Use "scrapy <command> -h" to see more info about a command

1、檢查語法

2、輸出抓取到的數據

scrapy   crawl ITtest

3、檢查是否可以檢查爬取

 scrapy   fetch  "https://hz.58.com/"

4、調試爬取頁面

scrapy   shell   "https://hz.58.com/"

 response.body.decode(response.encoding)

5、查看版本信息

scrapy   version

後期接着更新