How do I prevent access to my Apache website from the libwww-perl user-agent?

Some people caution against allowing the libwww-perl user-agent to crawl or access your website.

To prevent this type of access, you can add something like the following to your Apache configs (httpd.conf or .htaccess):

RewriteEngine on
RewriteCond %{HTTP_USER_AGENT} libwww-perl [NC]
RewriteRule .* – [F]

This will prevent the User-Agent libwwwl-perl from accessing your site and they will be served a 403 (Forbidden) error.

Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

To Top