Scraping Camel Settings
In this section, we will show you how to use Scraping Camel.
Enter your website URL here.
The number of downloads in a given interval (you can adjust it later)
Here you specify how many pages should be processed at one time in a certain time. Example 5.
Page Download Interval (you can adjust it later)
Here you specify the time for downloading the site. For example, 5 pages are downloaded every 500 ms..
In order to use Scraping Camel, you must first verify that you are the real owner of the site. Scraping Camel offers three verification options. It’s up to you which one you choose.
After verifying the domain, you still need to check if there is a sitemap on the site. The application does not work without it.
All URLs will be removed from the site.
It extracts Title from pages.
Last downloaded stažení
When was the last page of Scraping Camel downloaded?
What status code does the page contain (200, 404, etc.)
If predefined elements are not enough, you can choose your own. The “Custom element” field is used for this.
Here you enter how you want the element to be named.
Here you enter the beginning of the character, i. e. from where the data is to be extracted. Example of a sample element: <div class = “basic-description”>
Here you enter the end of the character, i. e. where the extraction should end. Example of a sample element: </div>
Here you can enter a regular expression. Example of a sample regular expression: <h2> (. *) </h2>:
The last step is to name your export file.