Scraping Camel Settings

In this section, we will show you how to use Scraping Camel.

1. Click the app. See. fig. below

screenshot app.mergado.com 2021.05.28 20 44 44

2. Display a list of pages

screenshot app.mergado.com 2021.05.28 20 52 07

3. Creating a new page

screenshot app.mergado.com 2021.05.28 20 53 39
  • Website name

    • Here you enter how you want your page to be named .
  • Website URL

    • Enter your website URL here.

  • The number of downloads in a given interval (you can adjust it later)

    • Here you specify how many pages should be processed at one time in a certain time. Example 5.

  • Page Download Interval (you can adjust it later)

    • Here you specify the time for downloading the site. For example, 5 pages are downloaded every 500 ms.

      .

4. Domain verification and sitemap

screenshot app.mergado.com 2021.05.28 20 55 49

In order to use Scraping Camel, you must first verify that you are the real owner of the site. Scraping Camel offers three verification options. It’s up to you which one you choose.

screenshot app.mergado.com 2021.02.23 12 33 34

After verifying the domain, you still need to check if there is a sitemap on the site. The application does not work without it.

5. Element settings

screenshot app.mergado.com 2021.02.23 12 45 45
  • Regular expression

    • Here you can enter a regular expression. Example of a sample regular expression: <h2> (. *) </h2>:

6. Complete the setup

screenshot app.mergado.com 2021.02.23 12 56 35

The last step is to name your export file.