The desire for greater control over how search engines index and display Web sites is driving an effort by leading news organizations and other publishers to revise a 13-year-old technology for restricting access. Formal rules allow a site to block indexing of individual Web pages, specific directories or the entire site, though some search engines have added their own commands. The new proposal seeks to have those extra commands apply across the board.
November 29, 2007 at 12:00 AM
1 minute read
The original version of this story was published on Law.Com
The desire for greater control over how search engines index and display Web sites is driving an effort by leading news organizations and other publishers to revise a 13-year-old technology for restricting access.
Currently, Google Inc., Yahoo Inc. and other top search companies voluntarily respect a Web site’s wishes as declared in a text file known as “robots.txt,” which a search engine’s indexing software, called a crawler, knows to look for on a site.
Presented by BigVoodoo
Law firms & in-house legal departments with a presence in the middle east celebrate outstanding achievement within the profession.
The premier educational and networking event for employee benefits brokers and agents.
The Legal Intelligencer honors lawyers leaving a mark on the legal community in Pennsylvania and Delaware.
A large and well-established Tampa company is seeking a contracts administrator to support the company's in-house attorney and manage a wide...
We are seeking an attorney to join our commercial finance practice in either our Stamford, Hartford or New Haven offices. Candidates should ...
We are seeking an attorney to join our corporate and transactional practice. Candidates should have a minimum of 8 years of general corporat...
MELICK & PORTER, LLP PROMOTES CONNECTICUT PARTNERS HOLLY ROGERS, STEVEN BANKS, and ALEXANDER AHRENS
