求助 scrapy not found tutorial

onedesigners

网上找了很多方法都没有用.... 实在不行了

scrapy crawl books -o books.csv后出错

源代码

1. #-*-coding:utf-8-*-
   
2. 
   
3. 
   
4. import scrapy
   
5. 
   
6. class BooksSpider(scrapy.Spider):
   
7.     #every marks of spider
   
8.     name = "books"
   
9. 
   
10.     #define beginning point
    
11.     start_urls = ['http://books.toscrape.com/']
    
12. 
    
13.     def parse(self,response):
    
14.         # get data
    
15.         # details in <article class = "product pod">
    
16. 
    
17.         for book in response.css('article.product_pod'):
    
18.             name = book.xpath('./h3/a/@title').extract_first()
    
19. 
    
20. 
    
21.             price = book.css('p.price_color::text').extract_first()
    
22.             yield {
    
23.                 'name':name,
    
24.                 'price':price,
    
25.             }
    
26. 
    
27. 
    
28. 
    
29.             next_url = response.css('ul.pager li.next a::attr(href)').extract_first()
    
30.             yield scrapy.Request(next_url,callback=self.parse)

复制代码

出错提示：

1. 2017-11-12 13:58:04 [scrapy.utils.log] INFO: Scrapy 1.4.0 started (bot: tutorial)
   
2. 2017-11-12 13:58:04 [scrapy.utils.log] INFO: Overridden settings: {'BOT_NAME': 'tutorial', 'NEWSPIDER_MODULE': 'tutorial.spiders', 'ROBOTSTXT_OBEY': True, 'SPIDER_MODULES': ['tutorial.spiders']}
   
3. Traceback (most recent call last):
   
4.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/spiderloader.py", line 69, in load
   
5.     return self._spiders[spider_name]
   
6. KeyError: 'tutorial'
   
7. 
   
8. During handling of the above exception, another exception occurred:
   
9. 
   
10. Traceback (most recent call last):
    
11.   File "/Users/onec/anaconda3/bin/scrapy", line 11, in <module>
    
12.     sys.exit(execute())
    
13.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/cmdline.py", line 109, in execute
    
14.     settings = get_project_settings()
    
15.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/utils/project.py", line 68, in get_project_settings
    
16.     settings.setmodule(settings_module_path, priority='project')
    
17.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/settings/__init__.py", line 292, in setmodule
    
18.     module = import_module(module)
    
19.   File "/Users/onec/anaconda3/lib/python3.6/importlib/__init__.py", line 126, in import_module
    
20.     return _bootstrap._gcd_import(name[level:], package, level)
    
21.   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
    
22.   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
    
23.   File "<frozen importlib._bootstrap>", line 941, in _find_and_load_unlocked
    
24.   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
    
25.   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
    
26.   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
    
27.   File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
    
28.   File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
    
29.   File "<frozen importlib._bootstrap_external>", line 678, in exec_module
    
30.   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
    
31.   File "/Users/onec/tutorial/tutorial/__init__.py", line 2, in <module>
    
32.     cmdline.execute("scrapy crawl tutorial".split())
    
33.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/cmdline.py", line 149, in execute
    
34.     _run_print_help(parser, _run_command, cmd, args, opts)
    
35.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/cmdline.py", line 89, in _run_print_help
    
36.     func(*a, **kw)
    
37.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/cmdline.py", line 156, in _run_command
    
38.     cmd.run(args, opts)
    
39.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/commands/crawl.py", line 57, in run
    
40.     self.crawler_process.crawl(spname, **opts.spargs)
    
41.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/crawler.py", line 167, in crawl
    
42.     crawler = self.create_crawler(crawler_or_spidercls)
    
43.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/crawler.py", line 195, in create_crawler
    
44.     return self._create_crawler(crawler_or_spidercls)
    
45.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/crawler.py", line 199, in _create_crawler
    
46.     spidercls = self.spider_loader.load(spidercls)
    
47.   File "/Users/onec/anaconda3/lib/python3.6/site-packages/scrapy/spiderloader.py", line 71, in load
    
48.     raise KeyError("Spider not found: {}".format(spider_name))
    
49. KeyError: 'Spider not found: tutorial'
    
50. one-2:tutorial onec$
    

复制代码

ooxx7788

应该要查看以下你项目的结构目录，可能从结构上就错了

onedesigners

ooxx7788 发表于 2017-11-12 16:28
应该要查看以下你项目的结构目录，可能从结构上就错了

ooxx7788

你这错误信息好像和你的代码不匹配啊。

1. 2017-11-12 13:58:04 [scrapy.utils.log] INFO: Scrapy 1.4.0 started (bot: tutorial)

复制代码

你这个里面的bot可是tutorial

onedesigners

ooxx7788 发表于 2017-11-12 20:02
你这错误信息好像和你的代码不匹配啊。

你这个里面的bot可是tutorial

已经头晕中··· 我从装pip开始就一直折腾

ooxx7788

onedesigners 发表于 2017-11-12 20:43
已经头晕中··· 我从装pip开始就一直折腾

按照demo再来一次吧，scrapy没那么容易上手

onedesigners

ooxx7788 发表于 2017-11-12 20:50
按照demo再来一次吧，scrapy没那么容易上手

好的，