# Indexing URLs in Tiledesk’s Knowledge Base with Advanced Options

<figure><img src="/files/dHvgdKvI6guike6UdaZJ" alt=""><figcaption></figcaption></figure>

This guide will walk you through the process of indexing URLs using the advanced options in the Tiledesk Knowledge Base. This feature allows you to paste one or more website URLs and fine-tune which parts of the webpage should be indexed, ensuring that your AI agent trains on the most relevant content while avoiding sections that could cause confusion.

### Step 1: Access the Tiledesk dashboard <a href="#step-1-access-the-tiledesk-dashboard" id="step-1-access-the-tiledesk-dashboard"></a>

1. [**Log in**](https://panel.tiledesk.com/v3/dashboard/#/projects) to your Tiledesk account.
2. From the left-hand side menu, click on **Knowledge Base**.

<figure><img src="/files/QW4NpHAoV8SgVWd1oxvD" alt=""><figcaption></figcaption></figure>

Step 2: Upload URLs

Within the Knowledge Base, you have two options for uploading URLs:

1. **Standard Indexing:** Indexes the full page.
2. **Advanced Options:** Gives you control over which parts of the page to index.

Select **Advanced Options** to customize the indexing process.

<figure><img src="/files/jZIFeUZnmiiPp4IqIOOb" alt=""><figcaption></figcaption></figure>

### Step 3: Configure Advanced Options <a href="#step-3-configure-advanced-options" id="step-3-configure-advanced-options"></a>

By choosing **Advanced**, you will see options, which I will explain below, one by one:

**Extract Tags (Mandatory):**\
Specify the HTML tags you want to index. For example, you might include tags such as \<h1>, \<h2>, \<p>, etc.

*If your page has multiple headings and paragraphs, list the tags to ensure they are all captured.*

**Unwanted Tags:**\
Here you can list any HTML tags you do not want to index.

*If there are sidebars or navigation elements with tags that you prefer to omit, add those tags here.*

**Unwanted Classnames:**\
Define the classnames that should be excluded from indexing.

*You might want to avoid indexing sections like main\_footer or any other classname that is not relevant to your training data.*

<figure><img src="/files/mGVffC8QDbCCy5EM6cYS" alt=""><figcaption></figcaption></figure>

### Step 4: Paste your website URLs <a href="#step-4-paste-your-website-urls" id="step-4-paste-your-website-urls"></a>

1. In the designated field, paste your website URLs. You can paste a single URL or multiple URLs at once.
2. Confirm your entries, and Tiledesk will process the indexing based on your advanced configuration settings.

<figure><img src="/files/0Fzz6ZbSaAZoMTM9sZYm" alt=""><figcaption></figcaption></figure>

### Step 5: Using your indexed Knowledge Base[#](https://gethelp.tiledesk.com/articles/indexing-urls-in-tiledesks-knowledge-base-with-advanced-options-39iqkg/#step-5-using-your-indexed-knowledge-base) <a href="#step-5-using-your-indexed-knowledge-base" id="step-5-using-your-indexed-knowledge-base"></a>

Once your URLs are indexed:

1. Head to the **Flows** section from the left-hand side menu.
2. Select the AI Agent you want to train using the indexed data.
3. In the **Design Studio**, choose the **"**[**Ask Knowledge Base**](/ai-chatbots-and-automation/actions-explained/ask-knowledge-base.md)**"** action. This action retrieves the relevant data from the indexed URLs using one of the OpenAI models.

<figure><img src="/files/p2cgxLQd6ZO8GKHVzrHg" alt=""><figcaption></figcaption></figure>

If you have any questions or need further help, please reach out to us at [**support@tiledesk.com**](mailto:support@tiledesk.com).

For more details on Tiledesk capabilities, visit [www.tiledesk.com](https://tiledesk.com/).

If you’re ready to jump in, you can [start with a free trial now](https://panel.tiledesk.com/v3/dashboard/#/signup).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://guide.tiledesk.com/ai-chatbots-and-automation/knowledge-base/indexing-urls-in-tiledesks-knowledge-base-with-advanced-options.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.