A file placed in the root directory of a website to instruct search engine bots on which pages to crawl or exclude from crawling.
User intent keywords
User intent keywords, also known as informational, navigational, or transactional keywords, are terms that reflect the underlying purpose or goal