• Lvxferre@mander.xyz
    link
    fedilink
    English
    arrow-up
    12
    ·
    11 months ago

    Yeah, that throws a monkey wrench into the idea. That’s a shame, because “either respect robots.txt or you’re denied access to a lot of websites!” is appealing.