Hi,

Using boost crawler, I notice a large number of 403 errors in the log. These refer to nodes that are not available to anonymous users, but are subscription-only premium content.

Is it possible to direct crawler to ignore certain nodes, so that the 403s are not generated?

Thanks

JB