Custom Robots.txt is a text file, which is uploaded on the server. Robots.txt file tells to Google search engine
bots which website pages, directories, or links should be indexed or not be
indexed in search result. Correct format of Custom robots.txt are given below.
