Perplexity is repeatedly modifying their user agent and changing IPs and ASNs to hide their crawling activity, in direct conflict with explicit no-crawl preferences expressed by websites.
  • AceFuzzLord@lemmy.zipEnglish
    3·
    2 months ago

    Anubis is a godsend, so long as A"I" companies cannot break it… and so long as we get people to switch to browsers like Mull and Ironfox.