Why LiteMage Crawler Cannot Warm Up the "Show All" Page

On category pages, Magento provides a drop down to select different per-page quantities to show, such as 30, 50, or all.

For the default page example:

https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets.html

You will get these vary pages:

https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/30.html
https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/50.html
https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/all.html

Show All is not the default status for that page. A cache vary cookie must be set in order for the show-all variation to be displayed. Currently, the crawler is only able to warm up default pages showing below, and not those variations that are initiated by cookies showing as above.

  • Admin
  • Last modified: 2017/11/13 17:12
  • by Jackson Zhang