This project is only a learning project, commercial use is prohibited!
preface
This project is to obtain housing information by crawling to 58 city page and parsing HTML, and to notify users subscribing to corresponding cities of newly released housing information through the customer service message of the official account. The project has very simple functions, which can be roughly divided into three parts:
- 58 tongcheng second-hand housing source data to climb to analysis
- Official account page
- Backstage housing data acquisition, user management, housing push, recharge
Crawlers were originally written using Python scrapy, but were later changed to Java using Jsoup for crawler parsing due to multiple asynchronous notifications for push functionality.
The project still has a few bugs, but it’s good enough as a learning project.
The two-dimensional code of the public number is not put, direct search [hacker search] can experience, the current business basically stops running, the public number only display function.
Begin the journey
Source portal: HiHouse
Pages to crawl:
Example of public account push:
List page
technology
The background
Related technologies
- spring boot
- mybatis
- mongodb
- xxl-job
- redis
- jsoup
- swagger
The project structure
Sawgger interface documentation
XXL – job console
The front end
- vue
- vant
- axios
- vue-router
Why only use these skills, don’t ask, ask is I only know these skills
Friendship transfer, a few small projects I wrote earlier:
HiTop hot list: HiTop hot list chart bed applet front and back open source: chart bed applet front and back open source Python implementation of the cloud home automatic check-in: Python implementation of the cloud home automatic check-in Java implementation algorithm recommended: Mahout practice: Java implementation algorithm recommended: Mahout practice