This is an old revision of the document!


Why LiteMage crawler not working on "show all" page?

In Magento's category page, Magento provides a function to select different showing quantities, such as 30/50/all.

For example: The default page:

https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets.html

Very pages:

https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/30.html
https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/50.html
https://www.example.com/outdoor-clothing/womens-clothing/womens-insulated-jackets/show/all.html

Since the show-all page has cache very cookie needed to be set and it is not default page for that URL, the crawler can not warm up such page at this stage.

  • Admin
  • Last modified: 2017/11/13 16:30
  • by Jackson Zhang