---
title: "Optimizing internet searches"
slug: "optimizing-internet-searches"
abstract: "Learn how to configure your sitemap and robots.txt files."
---
# Optimizing internet searches

The topics in this section describe how to configure sitemaps and robots.txt files to help search crawlers index the pages on your website, or instruct search crawlers to exclude certain pages from indexing.

- [Configure a sitemap](https://doc.sitecore.com/xp/en/developers/sxa/105/sitecore-experience-accelerator/configure-a-sitemap.html "Configure a sitemap")
- [Enable or disable language codes in sitemap URLs](https://doc.sitecore.com/xp/en/developers/sxa/105/sitecore-experience-accelerator/enable-or-disable-language-codes-in-sitemap-urls.html "Enable or disable language codes in sitemap URLs")
- [Configure the robots.txt file](https://doc.sitecore.com/xp/en/developers/sxa/105/sitecore-experience-accelerator/configure-the-robots-txt-file.html "Configure the robots.txt file")