Website A collection of related web pages accessible through a specific domain name or URL. Read More »
Robots.txt A file placed in the root directory of a website to instruct search engine bots on which pages to crawl Read More »