Is it necessary to use Robots.txt file?

[lokesh91]

Yes It is necessary, A robots.txt file gives instructions to web robots about the pages the website owner doesn’t wish to be crawled. This file is placed in root folder of website.