scrapy shell加请求头
$ scrapy shell
...
>>> from scrapy import Request
>>> req = Request(url, headers=headers)
>>> fetch(req)
>>>response.text # 这样一般就有数据了
$ scrapy shell
...
>>> from scrapy import Request
>>> req = Request(url, headers=headers)
>>> fetch(req)
>>>response.text # 这样一般就有数据了