robots.txt (Q80776)
Jump to navigation
Jump to search
standard used to advise web crawlers and scrapers not to index a web page or site
- robots.txt protocol
- Robots Exclusion Protocol
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | robots.txt |
standard used to advise web crawlers and scrapers not to index a web page or site |
|
Statements
0 references
Robots.txt
0 references
Identifiers
Sitelinks
Wikipedia(28 entries)
- arwiki معيار استبعاد الروبوتات
- azwiki Robots.txt
- cawiki Protocol d'exclusió de robots
- cswiki Robots.txt
- dawiki Robot Exclusion Standard
- dewiki Robots Exclusion Standard
- enwiki Robots.txt
- eswiki Estándar de exclusión de robots
- fawiki استاندارد استثناء کردن رباتها
- fiwiki Robots.txt
- frwiki Protocole d'exclusion des robots
- glwiki Robots.txt
- hewiki פרוטוקול אי הכללת רובוטים
- idwiki Robots.txt
- itwiki Protocollo di esclusione robot
- jawiki Robots Exclusion Standard
- kowiki 로봇 배제 표준
- nlwiki Robots Exclusion Protocol
- plwiki Robots Exclusion Protocol
- ptwiki Protocolo de exclusão de robôs
- ruwiki Стандарт исключений для роботов
- simplewiki Robots exclusion standard
- srwiki Standard isključenja robota
- svwiki Robots Exclusion Standard
- trwiki Robot engelleme standardı
- ukwiki Robots.txt
- zhwiki Robots.txt
Wikibooks(0 entries)
Wikinews(0 entries)
Wikiquote(0 entries)
Wikisource(0 entries)
Wikiversity(0 entries)
Wikivoyage(0 entries)
Wiktionary(0 entries)
Multilingual sites(1 entry)
- commonswiki Category:Robots.txt