In the robots.txt file, what does the “Disallow:” line do?

[palak-virmani-30ac6553 (Palak Virmani)]

In the robots.txt file, what does the “Disallow:” line do?

[pramila-y-fcfc8f35 (pramila.y BI)]

@palak-virmani-30ac6553

“Disallow:”

Web site owners use the /robots. txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The “Disallow: /” tells the robot that it should not visit any pages on the site.