A file placed in the root directory of a website to instruct search engine bots on which pages to crawl or exclude from crawling.
On-Page SEO
On-Page SEO refers to the optimization techniques implemented directly on a website’s individual pages to improve its search engine rankings.