[已解决]课件爬虫部分

490440758

有道词典爬虫都用不了了，访问会返回

您的请求来源非法，商业用途使用请关注有道翻译API官方网站“有道智云”: http://ai.youdao.com

求助啊

最佳答案

月排行榜 / 总排行榜

ba21

2017-9-24 11:20:27

1. import urllib.request
   
2. import urllib.parse
   
3. import time
   
4. import random
   
5. import hashlib
   
6. import json
   
7. 
   
8. url='http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule&sessionFrom=null'
   
9. u='fanyideskweb'
   
10. d='you'
    
11. f=str(int(time.time()*1000))
    
12. c="rY0D^0'nM0}g5Mm1z%1G4"
    
13. g=hashlib.md5()
    
14. g.update((u + d + f + c).encode('utf-8'))
    
15. head={}
    
16. head['User-Agent']='Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:54.0) Gecko/20100101 Firefox/54.0'
    
17. head['Host']='fanyi.youdao.com'
    
18. head['Referer']='http://fanyi.youdao.com/'
    
19. data={}
    
20. data['i']=d
    
21. data['from']='AUTO'
    
22. data['to']='AUTO'
    
23. data['smartresult']='dict'
    
24. data['client']=u
    
25. data['salt']=f
    
26. data['sign']=g.hexdigest()
    
27. data['doctype']='json'
    
28. data['version']='2.1'
    
29. data['keyfrom']='fanyi.web'
    
30. data['action']='FY_BY_CL1CKBUTTON'
    
31. data['typoResult']='true'
    
32. data=urllib.parse.urlencode(data).encode('utf-8')
    
33. 
    
34. req=urllib.request.Request(url,data,head)
    
35. response=urllib.request.urlopen(req)
    
36. html=response.read().decode('utf-8')
    
37. target=json.loads(html)
    
38. #print(html)
    
39. print('翻译结果： %s ' % (target['translateResult'][0][0]['tgt']))
    

复制代码

跳转到最佳答案楼层

ba21

1. import urllib.request
   
2. import urllib.parse
   
3. import time
   
4. import random
   
5. import hashlib
   
6. import json
   
7. 
   
8. url='http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule&sessionFrom=null'
   
9. u='fanyideskweb'
   
10. d='you'
    
11. f=str(int(time.time()*1000))
    
12. c="rY0D^0'nM0}g5Mm1z%1G4"
    
13. g=hashlib.md5()
    
14. g.update((u + d + f + c).encode('utf-8'))
    
15. head={}
    
16. head['User-Agent']='Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:54.0) Gecko/20100101 Firefox/54.0'
    
17. head['Host']='fanyi.youdao.com'
    
18. head['Referer']='http://fanyi.youdao.com/'
    
19. data={}
    
20. data['i']=d
    
21. data['from']='AUTO'
    
22. data['to']='AUTO'
    
23. data['smartresult']='dict'
    
24. data['client']=u
    
25. data['salt']=f
    
26. data['sign']=g.hexdigest()
    
27. data['doctype']='json'
    
28. data['version']='2.1'
    
29. data['keyfrom']='fanyi.web'
    
30. data['action']='FY_BY_CL1CKBUTTON'
    
31. data['typoResult']='true'
    
32. data=urllib.parse.urlencode(data).encode('utf-8')
    
33. 
    
34. req=urllib.request.Request(url,data,head)
    
35. response=urllib.request.urlopen(req)
    
36. html=response.read().decode('utf-8')
    
37. target=json.loads(html)
    
38. #print(html)
    
39. print('翻译结果： %s ' % (target['translateResult'][0][0]['tgt']))
    

复制代码

490440758

ba21 发表于 2017-9-24 11:20

谢谢大腿

但是有些地方不明白

1. g = hashlib.md5()
   
2. g.update((u + d + f + c).encode('utf-8'))

复制代码

这个是什么作用啊？

1. data['sign']=g.hexdigest()

复制代码

这个也不明白

如果大腿有时间回答一下，万分感谢