Robots.Txt File, located in an internet site's root directory, guides online search engine crawlers on what to index and what to ignore. It plays an important r It is a proprietary metric and is not used by search engines like google like Google in their algorithms. As an alternative, It's https://www.seoprd.com