Fix Pixel Coverage report issues caused by crawling

Using the Pixel Coverage Report

The effectiveness of your RollWorks advertising performance is dependent on having the Pixel  correctly installed and firing on all your website pages. 

The Pixel Coverage report on the Website Audiences helps you make sure that the Pixel is installed on every page of your website. This report is generated by an automated crawler that visits all pages on your website and checks for the status of the Pixel.

If the Pixel Coverage card shows Crawling Issues it means that the system that reviews all pages in your website and checks for a pixel couldn’t run on your website. Either because the crawler was blocked or because your website took a long time to load.

crawler error.png

 

Continue reading to learn the most common reasons why our crawling system may be failing and some solutions you can try to fix these issues.

 

How to Fix Crawling Issues 

Your account was created more than 30 days ago

Our crawler will run automatically on the 1st and 15th of the month during the first 30 days after your RollWorks advertiser account is created. If your account was created more than 30 days, and you don't have any active campaigns the crawler will stop running automatically. 

How to Fix: Click Launch Pixel Assistant and this action will initiate the crawler on demand. The Pixel Coverage will update in ~24 hours.

assistant.png

Your campaigns have been turned off for more than 30 days

Our crawler will run automatically on the 1st and 15th of the month as long as you have an active advertising campaign that is spending, and up to 30 days after you turn off your campaigns. If your your campaigns have been turned off for more than 30 days the crawler will stop running automatically. 

How to Fix: Click Launch Pixel Assistant and this action will initiate the crawler on demand. The Pixel Coverage will update in ~24 hours.

assistant.png

Your website pages load slowly

Our crawler has a limit of 5 seconds to load a web page. If your website uses third-party JS and other resources that cause the load time to be greater than 5 seconds our crawler will not be able to run. 

How to Fix: Having a slow website will impact the user experience of your visitors and can also harm the ranking of your website in search engines. Work with your website developer to improve loading times for your website. If you cannot reduce the loading time of all your web pages below 5 seconds you can manually audit Pixel coverage for each page using the PixelPal Chrome extension.

Your website is blocking our crawler in the Robots.txt file

Our crawler may be blocked by your robots.txt - this is a text file that you may upload to your website to block crawlers.

How to Fix:  Add the following to your robots.txt:

User-agent: NextRollPixelCrawler

Disallow:

Read this Google Support article for more details

Your website has a broken sitemap

If your website has a sitemap.xml file our crawler will use it to figure out other pages of your website worth inspecting. If there is an error in the syntax of your sitemap.xml file, our crawler will stop scanning your website and report a crawling error.

How to Fix: Work with your website developer to fix your website sitemap. If you cannot fix it, you can manually audit Pixel coverage for each page using the PixelPal Chrome extension.

 

How to crawl again your website after you fix any issues

If you made changes to your website and you want the RollWorks crawler to evaluate your website again, you can request a new crawl by using the main navigation to go to Audiences > Website Audiences scrolling down to the RollWorks Pixel section, and clicking Crawl Again at the bottom of the Pixel Coverage card.

crawl again 1.png

After requesting a new crawl, RollWorks systems will take up to 24 hours to run a new crawl and update the Pixel Coverage report. Keep in mind that if you refresh the page or come back to if before 24 hours you may still see crawling issues, so make sure to wait up to 24 hours and check the Last Update date before downloading a new report.

recrawl in progress.png

 

Alternative: Use PixelPal to validate coverage manually

If our crawler cannot run on your website, the Pixel Coverage Report card will not be able to verify if the Pixel is firing on all your website pages.  Alternatively, by using the Pixel Coverage Report you can manually verify if the pixel is installed on your website using our Chrome extension PixelPal. Please note that you will need to run PixelPal on each individual page of your website to determine if the pixel is not firing on specific pages. Read this article to learn how to install and use the PixelPal Chrome extension.

If you need assistance to verify that the Pixel is firing on all pages on your website please contact the RollWorks Customer Support team and we will be happy to assist you.

Was this article helpful?
0 out of 0 found this helpful

Articles in this section

See more
Chat with an agent
Mon - Fri 10am - 6pm EST
Send a support email
Mon - Fri 10am - 6pm EST