Filter out Spider and Bot traffic from SiteCatalyst | Community
Skip to main content
vabeachkevin1
Level 4
Feb 11, 2010 8:37 PM UTC
Delivered

Filter out Spider and Bot traffic from SiteCatalyst

There should be an option to filter out all spider and bot traffic from SiteCatalyst reports, very similar to what was available from the HBX User Agent Filtering option. 

20 replies

New Participant
Jun 14, 2022 11:30 PM UTC
New Participant
Apr 26, 2012 7:44 PM UTC
This one is now implemented.  You can turn it on in the admin console and enable the IAB bot list with a single click.  Custom bot rules can also be created for user agents or IP addresses.
Translate
Level 2
Dec 16, 2011 8:16 AM UTC

We have a very large amount of MSN bot traffic in our data - an MSN bot that executes java script. We had the same problem with Google preview bot last Nov.

 

Omniture needs to prevent bots that execute java script from getting in our data and more importantly we are PAYING for the server calls. How about refund???????? (lol)

Translate
New Participant
Nov 3, 2011 8:47 PM UTC

The bot handling reporting is looking really good.  Let me know if you would like to try it out in the beta environment.

Translate
cisco_webteam
Level 3
Oct 10, 2011 10:14 PM UTC

Yeah, i can't believe what's available in HBX is not available even in SC 15

Translate
Employee
Jul 27, 2011 9:09 AM UTC

We are making progress on bot filtering, but I can't provide a timeline at this point. 

Translate
jamest0
Level 2
Jul 18, 2011 8:26 AM UTC

Any update on this growing issue?

Translate
miikka
New Participant
Dec 9, 2010 12:38 AM UTC

This is very good idea, not least regarding the Google Preview "spider" bloating traffic. I'd like to see this option also in Data Warehouse.

Translate
benjamingaines2
Employee
Nov 22, 2010 8:05 PM UTC

Marking this "In Progress," per Bret Gundersen.

Translate
Employee
Apr 8, 2010 7:37 PM UTC
Excellent comments here. While bot traffic is currently a small percentage, we're looking into some ideas now, as more bots and spiders are starting to execute JavaScript and request images.
Translate