Open Source Tutorials - Open Source Training
Open source training & tutorials from experienced, passionate people
chrome icon firefox icon ie icon opera icon safari icon Sings in these Browsers
A- A A+
You are here: Home Forum

By A Web Design

Welcome, Guest
Username Password: Remember me
Forgot your password? Forgot your username? Create an account
Open Source Varsity Forum
Open Source Community
SEO Community

Importance of Robots.txt
(1 viewing) (1) Guest
All your queries regarding
What is SEO,
Building SEO for your website,
and tonnes more... will be solved in this forum
Reply Topic
New Topic
  • Page:
  • 1
TOPIC:

Importance of Robots.txt

Importance of Robots.txt 1 year, 1 month ago #574

  • dhuruv
  • OFFLINE
  • Senior Boarder
  • Posts: 60
  • Karma: 0
Hi,

Can anyone please tel me about the importance of robots.txt file? What is robots.txt? How is robots.txt useful for a website? How we can create this file? What's is the use of this file in SEO?

Please tell me about competitor analysis in SEO..
Reply Quote

Re: Importance of Robots.txt 1 year ago #579

  • avan12
  • OFFLINE
  • Junior Boarder
  • Posts: 35
  • Karma: 0
Robots.txt is a text file which you have to put into your website main directory.

When you add the Meta robots file the URL will be yourdomain/robots.txt.

This text file tell to crawler that which pages you allow and disallow to crawl and index in search engine.
Reply Quote
Reply Topic
New Topic
  • Page:
  • 1
Open Source Varsity Forum
Open Source Community
SEO Community
Powered by Kunena  Protected by Spam Fighter
Time to create page: 1.30 seconds
Login

Login

OSV Newsletter


Receive HTML?

NOTE: To prevent subscription to the OSV newsletter, uncheck the checkbox above.
Guest Blog for OSV
Free Ebook Download
Free Templates