Author Topic: What is Robots.txt in SEO?  (Read 62 times)

amitdigital

  • Hero Member
  • *****
  • Posts: 3027
  • Welcome to Digital Marketing Forum!
    • View Profile
Re: What is Robots.txt in SEO?
« on: January 10, 2022, 11:51:17 am »
A robots. txt file tells search engine crawlers which URLs the crawler can access on your site. This is used mainly to avoid overloading your site with requests; it is not a mechanism for keeping a web page out of Google.


Taxi Online Boeken Nederland l Goedkoop taxibedrijf in Tilbur

 

Digital Marketing Forum is a do-follow forum, post and discuss IT topics here and get dofollow signature. Discuss about SEO, SMO, Directory Submission, 301 redirection, robots, social bookmarking, Web design and development.