Requests庫的使用

• 基於urllib3改寫的，API更加方便, 簡單易用
• 幾句代碼實現代理、cookie... 設置

請求方式

requests.post('http://httpbin.org/post')
requests.delete('http://httpbin.org/delete')
requests.put('http://httpbin.org/put')
requests.header('http://httpbin.org/get')
requests.options('http://httpbin.org/get')

解析json

import requests
response = requests.get('http://httpbin.org/get')
print(type(response))
print(response.json())
# response.json() 等同於： json.loads(response.text)
print(type(response.json()))

輸出：

<class 'requests.models.Response'>
{'url': 'http://httpbin.org/get', 'origin': '111.206.170.62', 'args': {}, 'headers': {'Accept': '*/*', 'Connection': 'close', 'Accept-Encoding': 'gzip, deflate', 'User-Agent': 'python-requests/2.18.4', 'Host': 'httpbin.org'}}
<class 'dict'>

獲取二進制數據

獲取圖片二進制數據，保存到本地。

response = requests.get('https://b-ssl.duitang.com/uploads/item/201707/02/20170702174136_waZHh.thumb.700_0.jpeg')
with open('touxiang.jpg', 'wb') as f:
    f.write(response.content)
    f.close()

添加headers

訪問知乎：

import requests

headers = {
    'User-Agent': 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3159.5 Mobile Safari/537.36'
}
response = requests.get('http://www.zhihu.com/explore', headers=headers)
print(response.text)

基於post請求

import requests

data = {
    'name': 'dimples',
    'age': '23',
}
response = requests.post('http://httpbin.org/post', data=data)
print(response.text)

response

文件上傳

import requests
files = {'files': open('touxiang.jpg', 'rb')}
response = requests.post('http://httpbin.org/post', files=files)
print(response.text)

獲取cookie

response = requests.get('http://www.baidu.com')
print(response.cookies)
for key, value in response.cookies.items():
    print(key+"="+value)

輸出：

<RequestsCookieJar[<Cookie BDORZ=27315 for .baidu.com/>]>
BDORZ=27315

會話保持

模擬登錄

requests.get('http://httpbin.org/cookies/set/number/12345')
response = requests.get('http://httpbin.org/cookies')
print(response.text)

{
  "cookies": {}
}

**實現在同一個瀏覽器set和get: 使用session **

s = requests.Session()
s.get('http://httpbin.org/cookies/set/number/12345')
response = s.get('http://httpbin.org/cookies')
print(response.text)

{
  "cookies": {
    "number": "12345"
  }
}

證書認證

• verify=False：是否要進行證書的驗證，默認True

# 消除警告信息
<!--from requests.packages import urllib3-->
<!--urllib3.disable_warnings()-->

response = requests.get('http://www.12306.cn', verify=False)
print(response.status_code)

認證設置

from requests.auth import HTTPBasicAuth

response = requests.get('http://***', auth=HTTPBasicAuth('user', '123'))
print(response.status_code)

或者：

response = requests.get('http://120.27.34.24:9001', auth=('user', '123'))
print(response.status_code)