If you are reading this, you’ve probably seen the Adbeat robot visiting your site when checking through your server logs. Our software obeys robots.txt files, the standard to allow webmasters to tell web robots what portion of a site is allowed for access.
Why are we crawling the web?
Adbeat is gathering a statistical representation of advertising presented on the web. We are gathering this data in order to allow our customers better visibility into the online advertising marketplace. Our customers use this data to make better decisions on how and where to advertise their products or services.
Why are we crawling your site?
Adbeat is crawling your site on behalf of our user base because we have identified your site as being of interest to them for a source of quality advertising inventory.
We do not take content from your site for any purpose.
We are interested only in aggregating advertising statistics associated with your site.
Are you wasting my bandwidth?
Adbeat uses very little bandwidth to monitor your site. We are very aware that this may be a concern for site owners, and we make every effort to limit our page requests both by rate of request and total amount.
Most webmasters feel that the benefit of allowing our crawler is greater than any concern about bandwidth.
What are the benefits for site owners?
At Adbeat we are nuts about the potential of contextual advertising, and our customers feel the same way. Because we report statistics by site, the data collected from your site showcases your site’s inventory and provides you visibility as a potential for targeted advertising.
Ok, but what if I still want to exclude my site?
Our software obeys the robots.txt exclusion standard, described at http://www.robotstxt.org/wc/exclusion.html#robotstxt. To ban adbeat robot from visiting your entire website, place the following in your robots.txt file:
User-agent: adbeat_bot Disallow: /
To ban adbeat_bot from visiting a portion of your website, adjust the URL in the Disallow line to that specific portion of the website.
Please don’t rely on meta tags like <META NAME=”ROBOTS” CONTENT=”NOINDEX, NOFOLLOW”> – they will be ignored due to technology limitations.
If your site has any problems or you have further questions about what we do with the statistics collected, please contact us at firstname.lastname@example.org
Get A Free Account
Sign up for an Adbeat Basic account to see even more advertising data.
What You'll Get
See advertising strategies View all ad creatives Save your favorite ads.