Fayilo ya robots.txt yosungidwa muzu wa webusaiti yanuyi idzawombera ma robot ngati makasitomala a injini zomwe amafufuza ndi mafayilo omwe amaloledwa kukwawa. N'zosavuta kugwiritsa ntchito fayilo ya robots.txt, koma pali zinthu zina zomwe muyenera kukumbukira:
- Ma robot amtundu wakuda adzanyalanyaza mafayilo anu a robots.txt. Mitundu yowonjezereka ndiyo bots ndi ma robot omwe akufunafuna ma email kuti akukolole.
- Olemba mapulogalamu ena amalemba ma robot omwe amanyalanyaza fayilo ya robots.txt. Izi zimachitika molakwika.
- Aliyense angathe kuona mafayilo anu a robots.txt. Nthaŵi zonse amatchedwa robots.txt ndipo nthawi zonse amasungidwa pampingo wa webusaitiyi.
- Pomalizira, ngati wina akulimbana ndi fayilo kapena makalata omwe satulutsidwa ndi mafayilo anu a robots.txt kuchokera pa tsamba lomwe salipatsidwe ndi mafayilo awo a robots.txt, injini zofufuzira zimatha kuzipeza.
Musagwiritse ntchito mafayilo a robots.txt kuti mubise chilichonse chofunika. M'malo mwake, muyenera kuika zinthu zofunika kumbuyo kuseri kwapasipoti kapena kuchoka pa intaneti kwathunthu.
Mmene Mungagwiritsire Ntchito Mafanizo Atsopanowa
Lembani mawuwo kuchokera ku chitsanzo chomwe chili pafupi kwambiri ndi zomwe mukufuna kuchita, ndi kuziyika mu fayilo yanu ya robots.txt. Sinthani robot, mayina, ndi maina a fayilo kuti zigwirizane ndi kukonzekera kwanu komweko.
Maofesi Awiri Awiri.txt Files
Wogwiritsa ntchito: *
Sungani: /
Fayiloyi imanena kuti robot iliyonse (Wothandizira-wothandizira: *) omwe amaipeza amafunika kunyalanyaza tsamba lililonse pa tsamba (Disallow: /).
Wogwiritsa ntchito: *
Siyani:
Fayiloyi imanena kuti robot iliyonse (Wothandizira-wothandizira: *) yomwe imalowetsa imaloledwa kuyang'ana tsamba lililonse pa tsamba (Disallow:).
Mukhozanso kuchita izi mwa kusiya mafayilo anu a robots.txt opanda kanthu kapena osakhala nawo pa tsamba lanu.
Tetezani Maofesi Ena Ochokera Kumaloboti
Wogwiritsa ntchito: *
Siyani: / cgi-bin /
Salola: / temp /
Fayiloyi imati robot iliyonse (Wothandizira-wothandizira: *) omwe amaipeza amayenera kunyalanyaza makalata / cgi-bin / and / temp / (Disallow: / cgi-bin / Disallow: / temp /).
Tetezani Masamba Okhazikika Kuchokera ku Robot
Wogwiritsa ntchito: *
Salola: /jenns-stuff.htm
Salola: /private.php
Fayiloyi imati robot iliyonse (Wothandizira-wothandizira: *) omwe amaipeza amayenera kunyalanyaza mafayilo /jenns-stuff.htm ndi /private.php (Disallow: /jenns-stuff.htm Disallow: /private.php).
Lembani Robot Yeniyeni Kuchokera pa Malo Anu
Wogwiritsa ntchito-wothandizira: Lycos / xx
Sungani: /
Fayiloyi imanena kuti Lycos Bot (Wothandizira: Wothandizira / Lycos / xx) saloledwa kupezeka kulikonse pa tsamba (Disallow: /).
Lolani Kufikira Komwe Kukhazikika Kwambiri
Wogwiritsa ntchito: *
Sungani: /
Wogwiritsa ntchito: Googlebot
Siyani:
Fayilo yoyamba imalephera ma robot onse monga momwe tachitira pamwamba, ndipo kenako amalola Googlebot (Wothandizira: Wothandizira: Googlebot) kuti akwaniritse chirichonse (Disallow:).
Phatikizani Mipata Yambiri Kuti Mupeze Zomwe Mukuzifuna
Ngakhale kuti ndi bwino kugwiritsa ntchito mzere wogwiritsa ntchito Wogwiritsira ntchito, monga Wothandizira: *, mukhoza kukhala ochonderera monga momwe mumakonda. Kumbukirani kuti ma robot amawerenga fayiloyo. Choncho ngati mizere yoyamba imati ma robot onse amatsekedwa ku chirichonse, ndiyeno kenako mu fayilo iyo imati ma robot onse amaloledwa kupeza chirichonse, robot akhoza kukhala ndi mwayi wa chirichonse.
Ngati simukudziwa ngati mwalemba bwino mafayilo anu a robots.txt, mungagwiritse ntchito Zida za Google Webmaster kuti muwone mafayilo anu a robots.txt kapena lembani latsopano.