Enable LiteSpeed crawler on WordPress & cPanel

Enable LiteSpeed crawler on WordPress & cPanel

To enable LiteSpeed Crawler option server-wide in cPanel, edit the following file

/etc/apache2/conf.d/includes/pre_main_global.conf

By the official cPanel docs, only the following is mandatory:

<IfModule Litespeed>
 CacheEngine on crawler
</IfModule>

But I also recommend setting the following values to limit the crawler as shown on the image below:

CacheRoot folder in which to store the cached files
CRAWLER_USLEEP puts a minimum allowed value on the Delay field
CRAWLER_LOAD_LIMIT sets a default for the Server Load Limit field
CRAWLER_LOAD_LIMIT_ENFORCE sets a maximum allowed value on the Server Load Limit field
pre main globalconf 1024x645 - Enable LiteSpeed crawler on WordPress & cPanel

Afterward, restart LSWS, install and activate the LiteSpeed WordPress plugin

Set the crawler in WordPress:

crawler cron 1024x517 - Enable LiteSpeed crawler on WordPress & cPanel

whoami
Stefan Pejcic
Join the discussion

I enjoy constructive responses and professional comments to my posts, and invite anyone to comment or link to my site.