Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
litespeed_wiki:cache:lscps:crawler [2018/07/27 15:53] Eric Leu [Crawl Interval] |
litespeed_wiki:cache:lscps:crawler [2019/01/17 21:46] Eric Leu |
||
|---|---|---|---|
| Line 8: | Line 8: | ||
| - SiteMap: Prepare your site's sitemap, e.g. ''<nowiki>http://prestashop-123/456_sitemap.xml</nowiki>'' | - SiteMap: Prepare your site's sitemap, e.g. ''<nowiki>http://prestashop-123/456_sitemap.xml</nowiki>'' | ||
| - | ===== How to Use Crawl script===== | + | ===== How to Use the Crawler Script===== |
| [[https://www.litespeedtech.com/packages/prestashop/cachecrawler.sh | Download from here]] | [[https://www.litespeedtech.com/packages/prestashop/cachecrawler.sh | Download from here]] | ||
| - | Change the permissions so that the file is executable: | + | Change the permissions so that the file is executable: ''chmod +x cachecrawler.sh'' |
| - | ''chmod +x cachecrawler.sh'' | + | |
| - | ==== Crawl Desktop&mobile share same theme==== | + | Crawl when desktop & mobile share the same theme: ''bash cachecrawler.sh SITE-MAP-URL'' |
| - | ''sh cachecrawler.sh SITE-MAP-URL'' | + | |
| - | ==== Crawl Desktop&Mobile save different theme ==== | + | Crawl when desktop & mobile have different themes: ''bash cachecrawler.sh SITE-MAP-URL -m '' |
| - | ''sh cachecrawler.sh SITE-MAP-URL -m '' | + | |
| By default, in the Prestashop cache plugin Mobile View is DISABLED. To enable mobile view, navigate to **PrestaShop Admin -> LiteSpeed Cache -> Configuration** and set **Separate Mobile View** to ''Yes'' | By default, in the Prestashop cache plugin Mobile View is DISABLED. To enable mobile view, navigate to **PrestaShop Admin -> LiteSpeed Cache -> Configuration** and set **Separate Mobile View** to ''Yes'' | ||
| Line 24: | Line 21: | ||
| ==== More Options==== | ==== More Options==== | ||
| - | * To get help: ''sh cachecrawler.sh -h'' | + | * To get help: ''bash cachecrawler.sh -h'' |
| - | * To change default interval request from 0.1s to custom NUM value: ''sh cachecrawler.sh SITE-MAP-URL -i NUM'' | + | * To change default interval request from 0.1s to custom NUM value: ''bash cachecrawler.sh SITE-MAP-URL -i NUM'' |
| ===== How to Generate a Sitemap===== | ===== How to Generate a Sitemap===== | ||
| Line 48: | Line 45: | ||
| How often do we want to re-initiate the crawling process? This depends on how long it takes to crawl your site and what did you set for Public Cache TTL. \\ | How often do we want to re-initiate the crawling process? This depends on how long it takes to crawl your site and what did you set for Public Cache TTL. \\ | ||
| Default TTL is one day(24hr). Maybe you can consider to run the script by cronjob every 12 hours.\\ | Default TTL is one day(24hr). Maybe you can consider to run the script by cronjob every 12 hours.\\ | ||
| - | E.g. This will run twice a day, at 3:30am: ''30 3/15 * * * path_to_script/cachecrawler.sh SITE-MAP-URL -m -i 0.2'' | + | E.g. This will run twice a day, at 3:30am/15:30: ''30 3/15 * * * path_to_script/cachecrawler.sh SITE-MAP-URL -m -i 0.2'' |
| Note: You can also use [[https://crontab.guru/|online crontab tool]] help you to verify time settings. | Note: You can also use [[https://crontab.guru/|online crontab tool]] help you to verify time settings. | ||