Python爬蟲實例(二)爬取數據後併入excel

報錯:Module Not Found Error: No module named 'openpyxl'

則下載openpyxl模塊,pip install openpyxl

源碼:

import requests
from lxml import etree
import pandas as pd
#設置請求頭
headers = {
   'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:64.0) Gecko/20100101 Firefox/64.0'
}
cookies = {'cookie':'"108300"; bid=x6CWhyewqig; __utma=30149280.485109852.1574991282.1574991282.1574991282.1; __utmc=30149280; __utmz=30149280.1574991282.1.1.utmcsr=baidu|utmccn=(organic)|utmcmd=organic; ap_v=0,6.0; gr_user_id=056ec422-999e-4cc8-82e1-4757d6547298; gr_session_id_22c937bbd8ebd703f2d8e9445f7dfd03=a3df6afd-13f6-4470-b577-a185c4c218e3; gr_cs1_a3df6afd-13f6-4470-b577-a185c4c218e3=user_id%3A0; gr_session_id_22c937bbd8ebd703f2d8e9445f7dfd03_a3df6afd-13f6-4470-b577-a185c4c218e3=true; _vwo_uuid_v2=DEE210CAD2A1C37C8754AAD0465FEFC45|3c7ca2da3525dbfd34f59bad5030fbde; __gads=ID=9438760ce15e89b2:T=1574991108:S=ALNI_MbPmQ5P86tmDdlvMJS_0so-WCfqzQ; __utmb=30149280.4.10.1574991282'}
#保存列表
film = []
#封裝url請求方法
def get_film(url,headers,cookies):
    # 發送get請求
    response = requests.get(url, cookies=cookies, headers=headers).text
    # 獲取解析結果,etrrr.HTML只能解析str
    tree = etree.HTML(response)
    name_list = tree.xpath('.//div[@class="hd"]/a/span[@class="title"][1]/text()')
    film.extend(name_list)

if __name__ == '__main__':
    for value in list(range(0, 250, 25)):
        # 生成每一頁的地址
        url = "https://movie.douban.com/top250?start=" + str(value) + "&filter="
        get_film(url, headers, cookies)
    #使用pandas模塊將數據保存到excel文件中
    data1 = pd.DataFrame({
        "電影名稱":film
    })
    #將數據寫入到excel表格中
    data1.to_excel(excel_writer="豆瓣電影top250.xlsx",sheet_name='電影排行',columns=['電影名稱'])
    print(film)
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章