Requests是一个用Python语言编写的HTTP客户端库。它类似于urllib和urllib2。它基于urllib，但比urllib更方便。可以为我们省去很多工作，完全满足HTTP测试需求。在编写爬虫和测试服务器响应数据时经常使用它。到达。Requests的哲学是围绕PEP20的成语发展起来的，所以它比urllib更像Pythoner，更重要的是它支持Python3Beautifulisbetterthanugly。（美丽胜于丑陋）明确胜于含蓄。（清晰胜于模糊）简单胜于复杂。（简单胜于复杂）复杂胜于复杂。（复杂胜于繁琐）可读性很重要。（重要的是可读性）请求官网：https://pypi.python。org/pypi/requestsInstallRequests方法1）pip安装pipinstallrequests#python2.7pip3installrequests#python3.6方法2）源码安装下载requests-2.18.2.tar.gz解压安装：tarzxvfrequests-2.18。2.tar.gzcdrequestspythonsetup.pyinstall验证安装：$pythonPython2.7.13(v2.7.13:a06454b1afa1,Dec172016,12:39:47)[GCC4.2.1(AppleInc.build5666)(dot3)]在darwin上键入“help”、“copyright”、“credits”或“license”以获得更多信息。>>>importrequests>>>requests使用Requestsrequests封装Python的urllib和urllib2，所以爬取网页非常简单1.爬取网页importrequests#爬取米扑科技首页req=requests.get(url='http://mimvp.com')print("status_code:"+str(req.status_code))print("mimvptext:"+req.text)#抓取mimvp代理（包括请求参数)req=requests.get(url='http://proxy.mimvp.com/free.php',params={'proxy':'out_tp','sort':'p_ping'})print("status_code:"+str(req.status_code))print("mimvptext:"+req.text)爬取网页很简单，Pythonurllib三行代码，requests只需要一行代码处理urllib:urllib.urlopen('http://mimvp.com').read()urllib2:urllib2.urlopen('http://mimvp.com').read()或importurllib2req=urllib2.Request('http://mimvp.com')res=urllib2.urlopen(req)page=res.read()请求接口格式：requests.get('https://mimvp.com/timeline.json')#GET请求requests.post('http://mimvp.com/post')#POST请求requests.put('http://mimvp.com/put')#PUT请求requests.delete('http://mimvp.com/delete')#DELETE请求requests.head('http://mimvp.com/get')#HEAD请求requests.options('http://mimvp.com/get')#OPTIONS请求请求接口示例：importrequestsrequests.get('http://mimvp.com',params={'love':'mimvp'})#GET参数示例requests.post('http://mimvp.com',data={'love':'mimvp'})#POST参数示例Requestssetproxy#!/usr/bin/envpython#-*-encoding:utf-8-*-##Python请求支持http,https,socks4,socks5##Mipu代理示例：#http://proxy.mimvp.com/demo2.php##米扑代购：#http://proxy.mimvp.com##mimvp.com#2016-09-16importrequestsimportsslimportsocks,socket#需要引入socks.py文件请到米扑代理下载mimvp_url="http://proxy.mimvp.com/exist.php"mimvp_url2="https://proxy.mimvp.com/exist.php"mimvp_url3="https://apps.bdimg.com/libs/jquery-i18n/1.1.1/jquery.i18n.min.js"#使用代理http,httpsproxies={"http":"http://120.77.155.249:8888","https":"http://54.255.211.38:80",}req=requests.get(mimvp_url2,proxies=proxies,timeout=30,verify=False)print("mimvptext:"+req.text)#使用代理socks4proxies={'socks4':'163.121.188.2:4000',}socks4_ip=proxies['socks4'].split(":")[0]socks4_port=int(proxies['socks4'].split(":")[1])socks.setdefaultproxy(socks.PROXY_TYPE_SOCKS4,socks4_ip,socks4_port)socket.socket=袜子。socksocketreq=requests.get(mimvp_url2,timeout=30,verify=False)print("mimvptext:"+req.text)#使用代理socks5proxies={'socks5':'190.9.58.211:45454',}socks5_ip=proxies['socks5'].split(":")[0]socks5_port=int(proxies['socks5'].split(":")[1])socks.setdefaultproxy(socks.PROXY_TYPE_SOCKS5,socks5_ip,socks5_port)套接字.socket=socks.socksocketreq=requests.get(mimvp_url2,timeout=30,verify=False)print("mimvptext:"+req.text)本例中使用的mimvp代理支持http,https,socks4,socks5等协议，覆盖全球120多个国家，中国34个省市推荐mimvp代理：http://proxy.mimvp.com参考推荐：Pythonpyspider安装开发Python3urllib使用详解PhantomJS安装开发Node.js安装开发Node.jsSuperAgent安装开发
