Build spider pits in PyCharm and summarize the process below

Version 3.6 is recommended for Python, version 3.7 will run error-prone, need to modify a file, see the related articles on this site

 

Update PIP to latest version

python -m pip install –upgrade pip

Update PIP and scrapy files www.lfd.uci.edu/~gohlke/pyt… Find the corresponding file –>cp37 corresponds to PYTHon3.7

PIP install e: \ dl \ Twisted – 18.7.0 – cp36 – cp36m – win_amd64. WHL

PIP install e: \ dl \ Twisted – 18.7.0 – cp37 – cp37m – win_amd64. WHL

Install scrapy

pip install scrapy

 

Set up the project –>

Scrapy startProject Automatically generates a stack of files

 

PIP install virtualenv

Enter virtualenv venv in the created project folder

 

Import project –>

Pycharm’s open–> opens the project folder

 

After setting up the basic project, visit www.lfd.uci.edu/~gohlke/pyt… Find the corresponding file –>cp37 corresponds to PYTHon3.7

 

After downloading the file, use the file in the bottom console (Terminal) (enter the path based on actual conditions):

PIP install e: \ dl \ Twisted – 18.7.0 – cp37 – cp37m – win_amd64. WHL

 

If the update is successful, it will show up as the latest version in setings’ library file Settings

 

Install scrapy in library file management

 

Install pypiwin32 in the library file

———————————————— Copyright notice: This article is originally published BY CSDN blogger “JSship” under the CC 4.0 BY-SA copyright agreement. Please attach the original source link and this statement. The original link: blog.csdn.net/jsship/arti…