Thanks! sorry for delay, but I had a bad day.
It seems it has all that's required for a decent crawler.
Post it somewhere, and who knows, me or one of my clients will make the purchase if sales goes up.
Are you a professional coder, or learned on your own?
I work since 10 years with LiteSpeed and already have developed a couple of cache plugins.