Webmaster tools
Robots.txt protocol
When a search engine looks at a web site, it checks for a root directory file named 'robots.txt'. A Standard for Robot Exclusion was established in 1994 which the major search engines observe. It is a method for excluding certain parts of web sites from being scanned and indexed. The robots.txt protocol is recommended by Google for use by web masters. The method is not secure and it does not guarantee privacy.
Google Webmaster Central: Block or remove pages using robots.txt file
Showing posts with label web - tools. Show all posts
Showing posts with label web - tools. Show all posts
7.11.2010
Webmaster tools - Lynx web browser
Webmaster tools
Lynx web browser
All commonplace web browsers in use today provide graphical display. That's the modern way. The automated web content explorers, called searchbots or web spiders, used by search engines to map the web are much simpler. The search engines really don't "see" web pages the same way people do, and it is sometimes difficult to appreciate the difference. Yet, when designing a web page with the search engines in mind, understanding the difference can make an important difference.
The Lynx web browser is a hold-over from a prior computer age when text-only displays were the norm. Lynx is a text-only web browser that allows you to see a web page much more like how a search engine sees the page. Lynx is free software that can be downloaded here, but as mentioned, it is a piece of software that operated by a different set of rules, and it may take some effort to understand how it works.
Google specifically recommends the use of Lynx by web masters to understand best design practices better.
Lynx web browser
All commonplace web browsers in use today provide graphical display. That's the modern way. The automated web content explorers, called searchbots or web spiders, used by search engines to map the web are much simpler. The search engines really don't "see" web pages the same way people do, and it is sometimes difficult to appreciate the difference. Yet, when designing a web page with the search engines in mind, understanding the difference can make an important difference.
The Lynx web browser is a hold-over from a prior computer age when text-only displays were the norm. Lynx is a text-only web browser that allows you to see a web page much more like how a search engine sees the page. Lynx is free software that can be downloaded here, but as mentioned, it is a piece of software that operated by a different set of rules, and it may take some effort to understand how it works.
Google specifically recommends the use of Lynx by web masters to understand best design practices better.
Subscribe to:
Posts (Atom)
Posts
