Single Page / Multiple Items
Last updated
Last updated
This scraper setup gets many items from a single page.
For example, you could be scraping all the threads in one page of the subreddit /r/SaaS.
First, let’s enter our starting “URL” and prompt.
Next, click on the Edit (pencil icon) in the “Extract data” box and for “Items per page” select “Multiple items” and hit "Save".
For this example, we will limit the number of results to 10 but you can leave it as it is and it will scrape the whole page.
And you should see the 10 threads.
Good stuff. Now what if you want to scrape the top comment for each thread? Read on to find out how.