Client crawler platform (dSpider) provides Android/ios SDK, and supports explicit crawler and silent crawler. DSpider is a client crawler platform using Javascrip language, which consists of SDK, Pc tools (to be released soon), and cloud management platform. Details: dspider.dtworkroom.com/document

Scenarios and introduction of client requirements

If you don’t know what a client crawl is and what it does, you need to know the following article:

Crawler technology (I) An article to understand the status of crawler technology

Crawler technology (2) client crawler

Crawler technology (iii)- Client crawler from Android SDK release

Client crawl – answer users to ask

DSpider profile

IOS Integration Documentation

The official documentation: dspider.dtworkroom.com/document/io…

Demo: github.com/wendux/DSpi… Welcome (star)

Bonus: 9 features of the DSpider

  1. Break IP restrictions. IP restrictions are completely invalid for DSpider
  2. You can manually log in to the client during authorization, bypassing the verification code problem and providing a friendlier user experience.
  3. Can crawl dynamically generated web pages.
  4. Scripts use the javascript language, with zero threshold for front-end programmers.
  5. The crawl script is very easy to write, the code is minimal, you can use any front-end JS library, and dSpider has jQuery built in to make parsing web pages very easy.
  6. Test support; Support local debugging, at the same time provide PC testing tools.
  7. Powerful cloud management platform; Real-time monitoring of application crawl status, dynamic update scripts, error analysis, configuration delivery and many other functions.
  8. Support ios/ Android, support silent crawl.
  9. Script store; A complete ecosystem and user base, where users can publish scripts to the script store and other users can add them freely. Users don’t have to write their own code.

Dspider website: dspider.dtworkroom.com/document/in…