In short, if we only focus on publishing high-quality content and getting more backlinks, we will simply compete with thousands if not millions of other sites that are doing the same things. A robot.txt file, on the other hand, is simply a file that lets Google spiders know not …

more ...