IETF BibXML

Viewing source data: RFC9309 indexed from relaton-data-rfcs
docid.id RFC 9309
docid.type IETF
docid.primary True
docid#2.id 10.17487/RFC9309
docid#2.type DOI
docnumber RFC9309
language en
type standard
script Latn
date.value September 2022
date.type published
title.content Robots Exclusion Protocol
title.format text/plain
title.type main
abstract.content <p>This document specifies and extends the "Robots Exclusion Protocol" method originally defined by Martijn Koster in 1994 for service owners to control how content served by their services may be accessed, if at all, by automatic clients known as crawlers. Specifically, it adds definition language for the protocol, instructions for handling errors, and instructions for caching.</p>
abstract.format text/html
abstract.script Latn
abstract.language en
revdate September 2022
contributor.role author
contributor.person.name.completename.content M. Koster
contributor.person.name.completename.script Latn
contributor.person.name.completename.language en
contributor.person.name.initial.content M.
contributor.person.name.surname.content Koster
contributor.person.name.surname.script Latn
contributor.person.name.surname.language en
contributor#2.role author
contributor#2.person.name.completename.content G. Illyes
contributor#2.person.name.completename.script Latn
contributor#2.person.name.completename.language en
contributor#2.person.name.initial.content G.
contributor#2.person.name.surname.content Illyes
contributor#2.person.name.surname.script Latn
contributor#2.person.name.surname.language en
contributor#3.role author
contributor#3.person.name.completename.content H. Zeller
contributor#3.person.name.completename.script Latn
contributor#3.person.name.completename.language en
contributor#3.person.name.initial.content H.
contributor#3.person.name.surname.content Zeller
contributor#3.person.name.surname.script Latn
contributor#3.person.name.surname.language en
contributor#4.role author
contributor#4.person.name.completename.content L. Sassman
contributor#4.person.name.completename.script Latn
contributor#4.person.name.completename.language en
contributor#4.person.name.initial.content L.
contributor#4.person.name.surname.content Sassman
contributor#4.person.name.surname.script Latn
contributor#4.person.name.surname.language en
series.title.content RFC
series.title.format text/plain
series.number 9309
series.type main
keyword robot
keyword#2 crawler
keyword#3 robots.txt
id RFC9309