If you want to get high rank in search engines then you have to provide robots.txt file in your website.

If your website doesn’t having the robots.txt file then learn how to create that robots.txt file for your website and make sure that it doesn’t have any errors.