196@lemmy.blahaj.zone · 4 months ago

rulebots.txt

lemmy.world

321

rulebots.txt

lemmy.world

Furbland@lemmy.world to

196@lemmy.blahaj.zone · 4 months ago

Chat

jbk@discuss.tchncs.de
link
fedilink
arrow-up
32·
4 months ago
I thought major LLMs ignored robots.txt

196@lemmy.blahaj.zone

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other ^rules

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

2.36K users / day
5.9K users / week
10.5K users / month
20.3K users / 6 months
155 local subscribers
16.7K subscribers
18.2K Posts
207K Comments
Modlog

mods:
Moss@lemmy.blahaj.zone
greembow@lemmy.blahaj.zone
moss@lemmy.world
Queue@beehaw.org
funky-rodent [he/him]@lemmy.blahaj.zone
Peachy [they/them] @lemmy.blahaj.zone
threegnomes@lemmy.blahaj.zone
greembow@lemmy.world
remotelove@lemmy.ca
Roflmasterbigpimp@feddit.de
qaz@lemmy.world
A_Very_Big_Fan@lemm.ee
qaz@lemmy.blahaj.zone
qaz@lemmy.ca
A_Very_Big_Fan@lemmy.world
qaz@lemmy.dbzer0.com
Qaz@lemmy.ml
qaz@sh.itjust.works
qaz@lemmy.sdf.org