04-03-2018, 11:16 AM
Robot.txt file contains standard way to inform the web robot about which areas of the website should not be processed or scanned.
Users browsing this thread: 1 Guest(s) |
|