Sources
Sources are the knowledge your agent answers from. Add them in Sources in the agent menu, or on Step 3 when you create the agent.
Four kinds of source
| Source | Use it for |
|---|---|
| Files | Documents such as PDF, DOC, DOCX and TXT files. You can add several at once, or drag and drop. |
| Text | A policy, a price list or a description. Give it a clear title, such as "Refund requests", and paste the text. |
| Website | Pages from your website. See below for how crawling works. |
| Q&A | Exact questions and the answers you want given. |
PDFs: make sure you can select and highlight the text in your PDF. Scanned pages that are only pictures cannot be read.
Adding your website
Choose Website and pick one of three tabs:
- Crawl links: start at a page and follow its links to read more of your site.
- Sitemap: read the pages listed in your sitemap.
- Individual link: add one specific page.
Advanced options
- Include only paths (for example
blog/*, docs/*) and Exclude paths (for exampleadmin/*, private/*). - Slow scraping: recommended for sites that limit how fast they can be read.
Good to know
- Each crawl reads up to 20 pages. To add more, run another crawl on a different section of your site, or add pages with Individual link.
- Enter a plain website address such as
yourbusiness.com. Names, sentences, email addresses and internal addresses are not accepted. - Free plans have a limit on crawled links. When you reach it you will be told and offered to continue with the links you have.
If a website cannot be read
A failed website shows the reason beneath it, so you know what to do:
| What you see | What it means and what to do |
|---|---|
| The domain does not seem to exist | Check the spelling of the address. |
| This page was not found (404) | Check the address, or try your home page. |
| Security certificate problem | The site's owner needs to fix its certificate. |
| Took too long to respond / could not connect | The site may be down. Try again later. |
| Blocks automated crawling | Use the Sitemap tab or Individual link, or add the content as Text. |
| No readable text found | The site may load its content with JavaScript. Add the information as Text or Q&A. |
Remove a failed source with the bin icon and try another way. A failed source does not count as knowledge.
After adding sources
- New sources become part of your agent's knowledge shortly after you add them. If the AI tab says your agent needs retraining, follow the prompt.
- The Total size bar shows how much you have added. It is a guide, not a hard stop.
- Test in the Playground to check the agent now answers correctly.
Tip: Quality beats quantity. A short, accurate Text source about prices and hours is worth more than a hundred pages of general content.