This time, we want to crawl all the detailed housing information from the first 20 pages. The basic idea behind this should be: first, get all the individual urls from the 20 pages and form a list, and then loop through the url list, go into the single page, and retrieve the details.
The website to be crawled looks like:
The information we want to retrieve are "host-gender", "house title", "room image link", "host-name", "host-picture", "price", and "address".
I have learnt a systematic method to write a Python program. The structure of a basic Python application program looks like:
#!/us