n8n
Last updated
Last updated
The app is a powerful workflow automation tool. You can add the into n8n to integrate AI scraping into your workflows.
In this tutorial, we'll walk through an example of how you can use FetchFox and n8n to do market research on Reddit.
Watch this tutorial as a video:
Make sure you have the FetchFox n8n node installed. Is hosted at .
You can follow the n8n instructions on for more information.
For this example, we're going scrape the n8n subreddit, and see what companies people are talking about. Our end goal is a list of company names, and number of times those companies were mentioned.
To do this, we'll first need some comment threads. So lets add the first FetchFox node
Click on "FetchFox", and then choose "Find pages matching a pattern"
Once you have your credential, you can set up the node to crawl for URLs on Reddit. We're looking for comment threads on r/n8n, and you'll notice that all comment threads have this pattern:
The "*" is a wildcard matcher. Put this URL pattern into n8n as shown below.
Click "Test Step", and within a few minute, FetchFox will find URLs for some comment threads. It should look something like this:
Next, lets find out what companies people are talking about. For this, we'll use FetchFox to extract data.
Close the first, and add a new FetchFox node.
This time, add a node to do extraction, and pick "Extract multiple items per URL". This will find all the comments on each comment page.
To set up the extraction node, first tell FetchFox which URL to target. Drag the URL field from the previous node into the extraction node.
Then, lets add an extraction field. Click the button that says "Add data field to extract", and add one for company.
The entries here will be passed to the AI, so follow prompt writing best practices. The field description below is a good one for this tutorial:
I am looking for companies being discussed. Give the names of each company discussed in the comments, one by one, in the standard spelling.
When you're done, click "Test Step". You should see something like this:
This is a simple two step scraper workflow, and its very common. First, you find URLs, and then you get some data out of them.
We can plug this into a larger n8n workflow. For example, you can add a count and sort node to see the most frequently mentioned companies.
Your final workflow will look something like this:
The results in the final node should look something like this:
The FetchFox node is a poweful way to get any data from any website, and integrate it into your n8n workflows.
The first time you add a FetchFox node, you'll need to add your API key. You can find this a on your settings page at . Enter it into n8n.
