Website Structure

A website's structure refers to how the website is set up, i.e. how the individual subpages are linked to one another.

It is particularly important that crawlers can find all subpages quickly and easily when websites have a large number of subpages. For this reason, a website’s homepage needs to have links to the most important subpages. Files such as sitemap.xml and robots.txt also help the crawler do its job in this regard.