Seems like there may be some issue with the crawl rules. What is it looking for that would to the error "t.robots is not defined" ?