Robots Files Robot files are txt documents that reside on the root of a domain. These text files give bots direction on what to crawl and what not to crawl. The file can target specific or all bots to target in its request. “Do not crawl” directives can be specific to the URL or folder[…]
Open Graph Data The Open Graph (OG) protocol allows a page to dictate social share items. For example, OG is used by LinkedIn and Facebook, and employing it allows page owners to pre-set images to be shared, as well as the descriptions, titles and URLs that go with it. More info: http://ogp.me/ Sample Code: <head[…]
URL Structure/Hierarchy In DNS and Google Search Console, ensure account is set to manage URL variations, including http:, https:, www, and non-www sites. There should be a uniform method of delivering URLs so as not to cause duplicate content between what search engines see as distinct websites. Additionally, it’s important to ensure that sub folders[…]
Sitemaps Sitemaps are XML files that outline website URLs for search engines to easily access. Elements of the sitemap include location of file, priority of page, frequency of updates and images included on the page (among other elements). Sitemaps are ideally located at the root of a website (www.example.com/sitemap.xml), however, unlike robots files, they can[…]