All Videos
3DN Respond

3DN Respond Web Crawling Knowledge Base Tutorial

Jay McCormack
9 Sep 2025
2:11

Demonstrates the web crawler that automatically extracts and processes website content into the knowledge base.

We built 3D and respond to transform custom inquiries into exceptional experiences. We do this by streamlining, prioritizing and resolving requests across all of your channels. This empowers your team to deliver faster, more personalized support, builds, lasting relationships. And today, I want to show you how we deal with the knowledge base in 3D and respond. One of the critical parts of 3D and respond, because it adds all of that organizational knowledge to the response. There’s two ways that you can add information to the knowledge base. And today we’re going to talk about only one of those two ways and that is doing a web crawl. With 3D and respond, we include a powerful web crawling system. And this automatically builds your knowledge base from your existing website content. And here’s how it works. You simply provide a starting URL like maybe your homepage or your events page. And the system just starts exploring the crawler follows links on your website, identifies relevant content pages while avoiding things that are irrelevant, like duplicated content or navigation systems. As the crawler visits each page, it extracts all the meaningful information out, like the actual information your customers would need. While removing headers and footers and other elements. The extracted content isn’t just stored as is though. We break it down into smaller, focused chunks that are perfect for AI based questions and answers. Each piece of content is then converted into a special mathematical representation. That captures its meaning, not just the key words. And this is what allows the system to understand customer questions and find the most relevant information. This automated system eliminates the need to manually copy and paste content into your knowledge base. Your existing website investment becomes immediately useful for customer support, ensuring consistency between your public information and your support responses.