博客
关于我
Python3.6爬虫记录
阅读量:370 次
发布时间:2019-03-05

本文共 1295 字,大约阅读时间需要 4 分钟。

Python????????

1. Python2?Python3???

Python2?Python3??????????????????????

  • ?????Python3???print?????print()???Python2???print???
  • ????Python3?urllib2????urllib???????urllib.request?
  • ?????Python3???????utf-8??Python2???gbk???

2. GET?POST??

  • GET??????????????URL?????????????
  • POST????????????????????????data???
  • ????????headers???????HTTP?????User-Agent?

3. User-Agent???

???????????????????????User-Agent?Python-urllib/x.y?

4. URL?????

  • ?????urllib.parse.urlencode()??????URL?????
  • ?????parse.quote()?parse.unquote()????URL??????

5. HTTPS???????

Python3????SSL??????????????CA?????

6. ???Handler?Opener

  • Handler????????????Cookie?
  • Opener???build_opener()???????????
  • ????Opener???install_opener()????Opener??????

7. Cookies??

  • ??Cookie???CookieJar?HTTPCookieProcessor??????Cookie?
  • ???????Cookie?????????????

8. ???????

  • ???????re.compile()??????????
  • ?????match()??????????search()????????
  • ????????groups()???????sub()???????

9. ??DEMO??

Demo1?????
  • ???????urllib.request.Request??HTTP???
  • ??????????????????
  • ???????a+???????????
Demo2?????????
  • ????????requests???????????
  • XPath?????????????????
  • ???????????????????
Demo3???????
  • URL???????URL???
  • XPath?????lxml??????????
  • ??????????????JSON???

10. CSRF??

  • Token?????csrf_token???????
  • ???????????????????????????

?????????DEMO???????Python?????????????????????

转载地址:http://tavg.baihongyu.com/

你可能感兴趣的文章
Objective-C实现BF算法 (附完整源码)
查看>>
Objective-C实现binary exponentiation二进制幂运算算法(附完整源码)
查看>>
Objective-C实现binomial coefficient二项式系数算法(附完整源码)
查看>>
Objective-C实现bogo sort排序算法(附完整源码)
查看>>
Objective-C实现CaesarsCiphe凯撒密码算法(附完整源码)
查看>>
Objective-C实现cartesianProduct笛卡尔乘积算法(附完整源码)
查看>>
Objective-C实现check strong password检查密码强度算法(附完整源码)
查看>>
Objective-C实现circle sort圆形排序算法(附完整源码)
查看>>
Objective-C实现coulombs law库仑定律算法(附完整源码)
查看>>
Objective-C实现DBSCAN聚类算法(附完整源码)
查看>>
Objective-C实现dijkstra银行家算法(附完整源码)
查看>>
Objective-C实现Dinic算法(附完整源码)
查看>>
Objective-C实现disjoint set不相交集算法(附完整源码)
查看>>
Objective-C实现DisjointSet并查集的算法(附完整源码)
查看>>
Objective-C实现djb2哈希算法(附完整源码)
查看>>
Objective-C实现DNF排序算法(附完整源码)
查看>>
Objective-C实现double factorial iterative双阶乘迭代算法(附完整源码)
查看>>
Objective-C实现double factorial recursive双阶乘递归算法(附完整源码)
查看>>
Objective-C实现double hash双哈希算法(附完整源码)
查看>>
Objective-C实现double linear search recursion双线性搜索递归算法(附完整源码)
查看>>