Sitemap

Examines a sitemap to efficiently explore and index the architecture of a website.

Detailed Explanation

1. Name:

   • This field allows you to assign a specific name to your sitemap data source, helping you identify it easily within your project.

   • Example: You might name it "My Website Sitemap" if it pertains to your website’s structure.

2. Site Map URL:

   • This field is for specifying the URL of the sitemap you want to import. This should point to the sitemap file, typically ending in .xml.

   • Example: If your sitemap is located at https://example.com/sitemap.xml, you would enter this URL in the field.

3. Chunk Size:

   • This field specifies the number of tokens or characters in each chunk of data processed. The default value is set to 1024, but you can modify it according to your needs. Adjusting the chunk size can help in managing large amounts of data more effectively.

   • Example: If you expect a large sitemap, you might set the chunk size to 512 to facilitate easier processing.

4. Cost Information:

   • This section provides details about the cost associated with importing words from the specified sitemap.

   • Example: If it states "Cost per words: 0.035 tokens" and "Remaining words: 1279900685 Words," this indicates how many tokens will be charged for each word processed and the total number of words remaining for processing.