Partner program reports without bots

In this article, you’ll learn how to study partner program reports without bots.                    

Some actions in partners’ projects can be performed by bots. Such impressions and clicks are reported and distort one’s view of the conversions of programs and tools as well as possible income and other rates. To get correct data on the Travelpayouts programs, you can disregard bot traffic in statistics.

How to Exclude Bot Traffic From Reports

To exclude bot traffic from statistics, go to the Profile page and select the Hide bot activity checkbox in the Statistics section:

mceclip1.png

Once this option is activated, the reports in your account will only reflect data generated by the real users. 

Which Traffic is Considered Bot Traffic?

We consider bot traffic to be any automated traffic. Thus, the statistics don’t take into account the bots of search engines (such as Google), parsers, SEO and click-fraud bots, bots for vulnerability search, and others.

We don’t collect all automated traffic, but find the biggest and most popular bots. This helps us eliminate a significant number of bots from reports and show more accurate statistics.

How We Detect Bot Traffic

Every Internet user has a user agent (ID with additional parameters). The agents of large bots are known and stored in public sources.

We created a bot that:

  1. Collects fresh user agents with suspicious activity from open sources.
  2. Sends the received data to our database.
  3. Browses the history of Travelpayouts logs (system information files) and compares user agents in the database and logs.
  4. If the user agents match, they are marked as bots. These user agents are excluded from reports on partner programs.

In order for partners to get correct statistics, this algorithm is run daily and the data in the reports are updated regularly.