Is it necessary to use Robots.txt file?

[RH-Calvin]

Yes robots.txt file is necessary for providing information to search engines. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.