'UCS-2' codec can't encode character......问题解决方法

°蓝鲤歌蓝

今天无聊爬了一下豆瓣，我看到https://www.douban.com/photos/album/1649942160/里面是个黑白漫画，感觉有点意思，想把里面的图片爬取下来。
于是出现了这样的问题：'UCS-2' codec can't encode characters in position 40276-40276: Non-BMP character not supported in Tk
我觉得它的解决方法有点意思，所以发帖交流一下。哪位大神知道原理，可以在评论区告诉我，谢谢。
附上代码：

1. import requests
   
2. import os
   
3. import re
   
4. import sys
   
5. non_bmp_map = dict.fromkeys(range(0x10000, sys.maxunicode + 1), 0xfffd)
   
6. 
   
7. url = 'https://www.douban.com/photos/album/1649942160/'
   
8. 
   
9. def url_open(url):
   
10.   headers = {'User-Agent':
    
11.              'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.221 Safari/537.36 SE 2.X MetaSr 1.0'
    
12.              ,'Referer':'https://www.douban.com/'
    
13.     }
    
14. 
    
15.   response = requests.get(url,headers=headers)
    
16.   return response
    
17.   #html = response.text
    
18. #print(html)
    
19. 
    
20. html = url_open(url).text.translate(non_bmp_map)#text
    
21. #print(html)
    
22. p = r'<img width="130" src="([^"]+\.jpg)"'
    
23. img_addrs = re.findall(p,html)
    
24. print(img_addrs)
    
25. 
    
26. x = 1
    
27. os.mkdir("douban")
    
28. os.chdir("douban")
    
29. for each in img_addrs:
    
30.   file = str(x) +".jpg"
    
31.   with open(file,"wb") as f:
    
32.     img = url_open(each).content
    
33.     f.write(img)
    
34.     x +=1

复制代码