One of AIGoChat’s most powerful features is the website crawler. Just provide a URL and the platform automatically visits every subpage, collects content, and builds a complete chatbot knowledge base.
How does the crawler work? AIGoChat visits the homepage, detects all internal links, and systematically indexes each subpage. It collects text from product descriptions, articles, FAQs, service pages – everything publicly visible. The entire process usually takes a few minutes.
Crawling limits: Free plan covers 10 pages, Starter 50, Professional 500, Business unlimited.
Automatic updates: you can set a schedule for automatic re-crawling so the chatbot always has up-to-date information about your products and services.