Search results

  1. serpent_driver

    Is there another method of running the Crawler

    @Germont Preload ByCron crawler script is good, but he overlooks something in curl requests, that causes too much load and traffic and as result of this, requests take too much time. There are also some other deficits....
  2. serpent_driver

    Is there another method of running the Crawler

    Why not? I do it and it works as fast as with my dedicated server. :)
  3. serpent_driver

    Is there another method of running the Crawler

    I've developed similar working multithreading crawler, but mine is extended and has some more features for user agent, cookies, request headers for webp image, cache-control support and much more. This allows me to crawl up to 100k URLs within 1 hour on a shared hosting.
  4. serpent_driver

    Logs in Litespeed folder / dev/sda2 is 100 percent full

    Check this: https://docs.litespeedtech.com/lsws/configuration/#logrotationsize and this: https://www.litespeedtech.com/support/wiki/doku.php/litespeed_wiki:config:real-time-stats and basically all information about Logging...
  5. serpent_driver

    Is there another method of running the Crawler

    There are a lot of ways to warmup the cache, but each method does the same. It does request URLs of your page like LiteSpeed crawler does it. The question is if your provider will check this and disallows each method that crawls your page. The best way would be to kick this provider off. He...
  6. serpent_driver

    lsphp killed by SIGABRT

    PHP 5! WOW! You know we have year 2022?
  7. serpent_driver

    Cache Problem with my homepage for mobile

    https://www.litespeedtech.com/support/forum/threads/please-use-the-official-wordpress-forum.16028/
  8. serpent_driver

    How to configure LSWS to use different cache directory for each (sub) domain

    Is anybody interested in how to configure LSWS to use different cache directory for each (sub) domain?
  9. serpent_driver

    How to prevent error pages with status code 500 from being cached

    FYI: I solved it. Not 100 percent perfect, but almost.
  10. serpent_driver

    best litespeed enterprise configuration multi ipv4 and ipv6 10 cpu 60gb ram 400gb 1gbit network

    There is no good, better or bad configuration. LSWS comes as it is with the best configuration depending on your server configuration. FYI: All resources of your VPS are only virtual resources. That means 60GB Ram is VRAM only and can't be compared with RAM in a dedicated machine. The same with...
  11. serpent_driver

    Bug with LiteSpeed Cache in Zox News Theme

    https://www.litespeedtech.com/support/forum/threads/please-use-the-official-wordpress-forum.16028/
  12. serpent_driver

    esi:inline tags don't work

    For everyone who is interested in how to get ESI work in non Wordpress application let's start an auction. You want to know what has to be done to get ESI work? The best price will solve it. I am open for requests.
  13. serpent_driver

    5.4.1 version recaptcha protection invisible type not working

    You talk about version 5.4.1 of LiteSpeed webserver? Version 6.0.11 is already released since month. https://www.litespeedtech.com/products/litespeed-web-server/release-log
  14. serpent_driver

    Homepage Images , Carousel & Sliding menu not loading correctly & Aligning

    https://www.litespeedtech.com/support/forum/threads/please-use-the-official-wordpress-forum.16028/
  15. serpent_driver

    Googlebot occasionally gets 403 when reading sitemap

    The reason is defined in status code 403 itself. Access forbidden because of (user) defined rules. https://datatracker.ietf.org/doc/html/rfc7231#section-6.5.3 It seems there is a (rewrite) rule that blocks requests to sitemap.xml coming from specific user agents like "bot" or "sniffer".
  16. serpent_driver

    Advanced crawler for recache. some ideas and code

    Try this: For me on my test shared hosting server it works and is supported by LiteSpeed webserver. PHP scripts never stops and run for hours, but handle with care, if you don't have permissions to control running processes on your server. If so, you can't stop it!!!!! With this code script...
  17. serpent_driver

    How to prevent error pages with status code 500 from being cached

    Yes, but there are not only cache plugins made by LiteSpeed. The world is greater than Wordpress and LSCWP. That's why I can't agree your philosophy about what should be cached or not. Of course, it has to be a goal. There are more arguments not to cache pages that have no status 200 than to...
  18. serpent_driver

    Litespeed and TCP Fast Open

    Enable QUIC and you will get more than TCP Fast Open is able to fasten. QUIC is supported by all modern browsers and also Google itself uses QUIC.
  19. serpent_driver

    How to prevent error pages with status code 500 from being cached

    Yes, I know, but Error 500 is only an example for all other != 200 status codes. What about 400, 401, 410, 30x?
  20. serpent_driver

    Litespeed cache causing Plesk backup issues

    To limit backup or to exclude files or directory from being backuped is part of control panel and not part of LiteSpeed. LSWS is only a webserver and not a software for server administration. So you should ask Plesk support.
Top