Reddit says Microsoft’s Bing, Anthropic, and Perplexity have scraped its data without permission. “It has been a real pain in the ass to block these companies.”

  • bionicjoey@lemmy.ca
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    1
    ·
    2 months ago

    Beyond that, if you are serving webpages with data on them, you don’t get to decide what people do with those pages. They can’t stop search engines from scraping

    • bassomitron@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      2 months ago

      Just to nitpick, they can stop scraping, anyone can. However, doing so would require implementing barriers that tend to also negatively effect sites that are dependent on being discovered and browsed.