Robots.txt (Robots File) Explained - SEO Video Tutorial

Get the latest Flash Player to see this video.

* HD format might not be available

Play in: Low Quality | High Quality | HD Quality *

Local Comments (0)

Nothing Found!

Youtube Comments (5)

Dec 6, 2011
irynski Says:
Nicely presented! Although I've been working with site design for over 15 years, I know that people still overlook the power of robots.txt and wonder why info from folders/files can be found if certain strings of search words will bring up directories on their site which they've kept out of their sitemap.xml, etc. Just wondering whether you could take a look at my bots directives for a site used specifically for 'freebie' downloads which I don't want appearing ANYWHERE.

Nov 25, 2011
Valca000 Says:
@3:04 start with admin? or private???

Nov 25, 2011
khalidzahran1 Says:
Tx for this

Nov 25, 2011
anthonycharlez Says:
Excellant!

Nov 25, 2011
riccardoNL2 Says:
:D

Video Details

In this week's web design video blog, Nick and I explain the purpose of a robots.txt file and also share the common Robot Exclusion Standards. Checkout the supporting code at http://www.webdesigncreare.co.uk/blog/videos/
robots-txt.html More