There is an unsaved comment in progress. You will lose your changes if you continue. Are you sure you want to reopen the work item?
Timeout when site is crawled
Before you read this, we're currently using the latest version of IIRF 2.1
We have been using IIRF (version one) for a while now, and recently changed the URL structure of our website. The old URL structure was redirected via regex commands and this worked well, however we also had to add about 100 manual redirection URLS to the isapirewrite4.ini
Our SEO then noticed that when he tried to crawl our site using XENU, the crawler picked up "timeout" on many URLs that were working. Through trial and error we isolated the problem to the IIRF rewriter. Removing the entries we added from the ini
file leaving just the regex stuff (reduced the ini file from 32k to 6k) then made the IIRF work again.
Thinking this was a bug in IIRF we upgraded to 2.1 but it's still doing the same thing. Provided the IIRF.ini file remains small it works, if the IIRF.ini file grows (in this case to 32k) it causes crawler timeouts again.
Are you able to help us resolve this?