The Robots.txt file is used to restrict search engine crawlers from accessing sections of your site. Although the file may be very handy, It is also a straightforward way to inadvertently block crawlers. Suppose you are the journalist who wrote The Guardian article on quickly style. In that circumstance, https://www.youtube.com/watch?v=EVeTP0aV8gY