programming.dev
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Furbland@lemmy.world to 196@lemmy.blahaj.zone · 9 months ago

rulebots.txt

lemmy.world

message-square
34
link
fedilink
321

rulebots.txt

lemmy.world

Furbland@lemmy.world to 196@lemmy.blahaj.zone · 9 months ago
message-square
34
link
fedilink
  • Aeri@lemmy.world
    link
    fedilink
    arrow-up
    66
    ·
    9 months ago

    oh no, Reddit is like, the only way to have google still be useful.

    • germanatlas@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      54
      ·
      9 months ago

      Funnily enough, google is also the only way to have Reddit be useful.

      Their own search function has been nothing but garbage.

    • morgunkorn@discuss.tchncs.de
      link
      fedilink
      arrow-up
      43
      ·
      9 months ago

      That’s the catch, Google made a deal with Reddit and remains the only search engine allowed to access its data for indexing. It cuts off every other search engine

      • vortic@lemmy.world
        link
        fedilink
        arrow-up
        27
        ·
        9 months ago

        Tell me that there is an anti trust suit over this.

        • Furbland@lemmy.worldOP
          link
          fedilink
          arrow-up
          26
          ·
          9 months ago

          There’s a suit over google in general so this may well be part of it

      • TriflingToad@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        9 months ago

        really? ddg will show me reddit links, did they have to make a webscraper or something

        • morgunkorn@discuss.tchncs.de
          link
          fedilink
          arrow-up
          4
          ·
          9 months ago

          There’s a cutoff date, anything indexed before the robots.txt was changed stays in the index

    • riodoro1@lemmy.world
      link
      fedilink
      arrow-up
      31
      ·
      9 months ago

      We fucked the internet. It’s proprietary now.

      • Furbland@lemmy.worldOP
        link
        fedilink
        arrow-up
        11
        ·
        edit-2
        9 months ago

        we fucked the internet

        kinky

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          8
          ·
          9 months ago

          cat5 sounding you say?

          • Swedneck@discuss.tchncs.de
            link
            fedilink
            arrow-up
            2
            ·
            9 months ago

            cat5-o-nine-tails

    • Norah (pup/it/she)@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      9
      ·
      9 months ago

      Good news! Google paid up and still has access I’m pretty sure.

      • Furbland@lemmy.worldOP
        link
        fedilink
        arrow-up
        1
        ·
        9 months ago

        That’s bad news, that means the internet is dying

        • Norah (pup/it/she)@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          9 months ago

          Sorry, the /s was sort of implied.

          • Furbland@lemmy.worldOP
            link
            fedilink
            arrow-up
            2
            ·
            9 months ago

            Ah, sorry. I have trouble with that sometimes :P

196@lemmy.blahaj.zone

196@lemmy.blahaj.zone

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

Be sure to follow the rule before you head out.


Rule: You must post before you leave.



Other rules

Behavior rules:

  • No bigotry (transphobia, racism, etc…)
  • No genocide denial
  • No support for authoritarian behaviour (incl. Tankies)
  • No namecalling
  • Accounts from lemmygrad.ml, threads.net, or hexbear.net are held to higher standards
  • Other things seen as cleary bad

Posting rules:

  • No AI generated content (DALL-E etc…)
  • No advertisements
  • No gore / violence
  • Mutual aid posts are not allowed

NSFW: NSFW content is permitted but it must be tagged and have content warnings. Anything that doesn’t adhere to this will be removed. Content warnings should be added like: [penis], [explicit description of sex]. Non-sexualized breasts of any gender are not considered inappropriate and therefore do not need to be blurred/tagged.

If you have any questions, feel free to contact us on our matrix channel or email.

Other 196’s:

  • [email protected]
  • [email protected]
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 870 users / day
  • 2.51K users / week
  • 5.55K users / month
  • 18.1K users / 6 months
  • 164 local subscribers
  • 17.5K subscribers
  • 19K Posts
  • 221K Comments
  • Modlog
  • mods:
  • Moss@lemmy.blahaj.zone
  • greembow@lemmy.blahaj.zone
  • moss@lemmy.world
  • Queue@beehaw.org
  • funky-rodent [he/him]@lemmy.blahaj.zone
  • Peachy [they/she] @lemmy.blahaj.zone
  • threegnomes@lemmy.blahaj.zone
  • greembow@lemmy.world
  • remotelove@lemmy.ca
  • Roflmasterbigpimp@feddit.de
  • A_Very_Big_Fan@lemm.ee
  • qaz@lemmy.blahaj.zone
  • A_Very_Big_Fan@lemmy.world
  • qaz@lemmy.sdf.org
  • qaz@lemmy.world
  • qaz@sh.itjust.works
  • BE: 0.19.11
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org