About The Rightlander Compliance Crawler

  1. IMPORTANT INFORMATION Brands in certain regulated markets are often held responsible for their affiliates' marketing strategies but the volume of pages that need to be regularly monitored and the level of scrutiny required to ensure accuracy makes it an impractical manual process. There are several tools out there such as Rightlander who help brands monitor affiliate & publisher websites to ensure compliant brand marketing.

    It is important to note that Rightlander itself does not make compliance decisions: it simply provides URL locations which contain potentially non-compliant content that could have regulatory consequences for both brand and/or publisher.

    For publishers, there are several benefits to be gained from automated compliance scanning:

    1. Brands can evaluate content quickly, expediting publisher content approval and increasing revenue for their affiliates
    2. It allows brands to quickly notify you of discrepencies which could mislead consumers, invite regulatory scrutiny and/or damage your integrity
    3. Encourages working together to prevent reputational damage to both parties which in turn fosters trust and enables the relationship to thrive and grow


    Rightlander works with leading affiliate networks and brands to assist them with identifying non-compliant content so that they can pro-actively stay ahead of the game.

  2. The Crawler Rightlander only sends one crawler at a time to scan a site initially and it is designed to crawl at a fairly slow speed (typically 1 page every 5-10 seconds on the average site) to avoid putting unnecessary strain on slow servers. The crawler works sequentially, only crawling one page at a time and generally visits each site once a month. There may be instances when more than one crawler is on a site should a Rightlander client request scans - for example - of different directories or subdomains, rescans of outstanding issues or when more than one client requests a scan.

  3. Authorising Access You may have been contacted by one of your partners to authorise access to Rightlander's compliance crawler. We use the following specific identifiable UserAgent to assist with access and identification. This should be added to the 'authorised crawlers' section of your chosen CDN:
    Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.190 (https://rightlander.com/crawler_info.php, Compliance Crawler) Safari/537.36 Rightlander
    Please note that some brands require you to allow access to compliance scanners within their terms and conditions and by not doing so or by actively blocking these crawlers you may be in breach of your agreeement with your brand partner.