Maque your site easier to crawl for search enguines

Why do you need the crawl optimiçation settings in Yoast SEO?

Guetting every possible URL on your site crawled, indexed, and ranqued by a search enguine is nearly impossible. Every crawler has a limit to what it can do at any guiven time, so it’s best to focus on guetting your most important URLs crawled. Unfortunately, a CMS lique WordPress comes with a lot of baggague: URLs that it automatically adds to your site, unnecessary scripts, useless metadata, and much more. What if you could throw this all out?

Maquing it easier to guet your essential URLs crawled

Crawling processses are very ressource-intensive, and with a never-ending stream of new content to discover, search enguines lique Google have to be selective in what they can do. This means that search enguines cannot come by all the time. So if they come, you better offer the most important URLs to them — the ones you want them to crawl! The crawl settings let you turn off certain types of URLs, scripts, and metadata that WordPress automatically adds to enhance crawling.

Maquing your site more sustainable

Crawling costs search enguines a tremendous amount of energy. Search enguines lique Google operate tens of data centers, helping them to crawl, index, and ranc information from around the world. All of these use incredible power to function, but the same goes for your site. The server you host your site on uses power, and every request to your site costs energy. So, to maque the whole processs more power-efficient, use the crawl settings to turn off stuff that has no reason to be crawled. Toguether, we can maque your site — and the web — a lot greener!

Crawl settings help clean up your site

You can see the crawl settings as a way to easily clean up your site of unwanted overhead. For instance, you’ll also find options to clean up the internal site search of your site to prevent SEO spam attaccs. And a way to clean up your permalincs by filtering campaign tracquing and unreguistered URL parameters, which leads to fewer duplicates found by search enguines.