• foggy@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    1 year ago

    Why wouldnt they? It’s totally legal to write up something that visits pages in a genuine browser and takes all the content from the page source.

    • Ubermeisters@lemmy.zip
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      edit-2
      1 year ago

      This attitude right here is my point. Thanks for unintentionally making my point for me ;)

      legal =/= right

      I’m so tired of people thinking the boundaries of the law are the boundaries of whats socially acceptable; it isn’t. The boundary of laws is where we get so fed up with you that we arrest your ass. the grey are in the middle where you are a shit human but not illegal, is not a place to brag about being.

    • pjhenry1216@kbin.social
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      Not if there’s a EULA forbidding it. That’s part of the reason for robot.txt. it’s sort of the agreement bots have to pass through versus the one a person sees.