Custom counts and fields

Custom counts and fields can help you crawl and extract data of your choice. You can use this feature to gather author information, look at content quality based on page types, and many more.

Customer counts and fields

The custom counts and fields can be found in Project settings >> Snippets

Figure 1: Custom counts and fields in project settings

Custom counts: Counts the number of the times an element appears on a URL. Ideal if you want to count the number of times specific HTML elements, such as comments, appear on a URL.

Data reading

The custom counts and fields support the following selectors: Xpath, CSS Path, and Regex, which in turn support the following functions: Custom counts

• Regex: Search in text / in HTML
• XPath
• CSS Path

Custom fields

• Regex: Search in text / in HTML
• XPath: Only extract text / complete tag
• CSS Path: Only extract text / complete tag

If you are already familiar with Regex, Xpath, and CXX Path, you can skip the next step. This shows you how you can use these to create appropriate selectors with just a few clicks and successfully extract your data.

Creating selectors

Learn how you can successfully create a selector using Google Chrome (or Firefox + Firebug): 1. Start with requesting the respective URL, e.g., from the category you want to extract. 2. Choose the corresponding element (e.g., T-shirt), right click, and select "Inspect".

Figure 2: The first step in creating a selector

3. The chosen HTML element should now be preselected in the open inspector. Next, right click on the element, select "Copy" and then "Copy XPath".

Figure 3: How to copy an XPath

Test selectors

In order to make sure that the copied XPath really works, it is advisable to first test it. To do this, go to Project settings >> Snippets >> Test a selector. Add the URL and XPath and click on test:

Figure 4: The selector test shows if the XPath is functional

Creating a custom field

The next step entails setting the tested XPath as a custom field. To do this, click on "Custom field", add the XPath, and select "Xpath: Get text only":

Figure 5: Set XPath as a custom field

Start crawl and get report

Before you start the crawl, you should check all settings again, particularly if you have multiple custom fields. To do this, click on Crawl setting >> Test settings, add any URL, and click on "test". For you to now see your data, you can either wait for the next automatic crawl or initiate it manually. To do this, click on the top right icon next to "Crawl settings". Once the crawl is done, you can view the custom report under Content >> Custom fields >> Selector name (Category). At the very top (1), you can see the number of times your custom field was found. Since not all of the examined URLs have a category, it is perfectly normal if nothing is found on some of the URLs. The next section (2) shows you an additional overview of all the categories found. The number below the category name shows you how many URLs were found in the respective category. If you wish to select either one of them, simply click on the respective category. The table below contains a list of all the URLs that were found, including their OPR and category names.

Custom fields created successfully

It is also possible to easily create custom fields even if you are not familiar with Regex or XPath. The report options with Ryte also allows you to add each custom field as a column or overview in every report and then filter.

Examples of applications

Since you now know how easy it is to create custom fields, I would like to show you some examples of applications that you can also realize on your own. Note: CF = custom fields CC = custom counters

Content analysis

Analysis of the average words per author: Word statistics >> No. of words report + Author's name (CF) Poor internal linking of old content: Links >> PageRank distribution or Click path + Publication date (CF) Identify popular article: Content >> See the custom fields + No. of comments (CF) or Count comments DIV (CC) Content quality based on page types: Required report + Content Type Identifier (CF)

Picking out technical information (XPath)

Schema.org:

(//*[@itemtype])[1]/@itemtype (//*[@itemtype])[2]/@itemtype

Identifying the mobile version

//link[contains(@media, '640') and @href]/@href

Picking out the email address

//a[starts-with(@href, 'mailto')][1] //a[starts-with(@href, 'mailto')][2]

Use of IFrames

(//iframe/@src) [1] (//iframe/@src) [2]

Conclusion

As you can see, it is quite easy to create custom fields and effectively use them in OnPage.org Zoom for different purposes. Try it yourself to e.g., get the prices of your online shop in order to obtain important information. You can also extract the number of reviews or the reviews themselves and view them in Ryte Website Success. Experiment with the various options of the custom fields and discover new applications. We look forward to hearing about your experiences as you successfully use this powerful feature. Happy Analyzing!