Python 抓取網頁數據亂碼時, 設置編碼

Python 抓取網頁數據亂碼時, 設置編碼

    headers = {'referer': referer, 'user-agent': user_agent}
    r = requests.get(url, headers=headers, proxies=proxies)
    # print(r.encoding)  # gb2312
    r.encoding = 'GBK'
    text = r.text
    html = BeautifulSoup(text, "lxml")