The software or technology used to create and manage a website, offering various tools and features to design, develop, and maintain web content.
Robots.txt
A file placed in the root directory of a website to instruct search engine bots on which pages to crawl