• BrikoX@lemmy.zip
    link
    fedilink
    English
    arrow-up
    68
    ·
    edit-2
    1 year ago

    Brave Search fully using their own index since April 27, 2023. But they refuse to identify their crawler and rely on googlebot if sites want to be excluded. Also their search API monetization of possible copyrighted content while understandable is a bit doubious due to their public stance on transparency.

    StartPage also blocks VPN usage.

    DuckDuckGo by their own admission now re-rank “trusted” sites to the top when it comes to what they clasify as"misinformation" so calling their “censorship” mild is huge understatement.

    • Franzia@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      16
      ·
      1 year ago

      If I wanted to search for unverified info or misinfo, I could, but almost always I am lookkng for factual and sourced information. Please don’t force me to do otherwise.

        • DigitalJacobin@lemmy.ml
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          That’s how all search engines fundamentally work though. The whole point if that they try to bring the most relevant results to the top and downrank things like spam and unhelpful/irrelevant results. Downranking misinfo spam websites isn’t “censorship”. Not ranking resullts would make search engines completely pointless.

          • RaivoKulli@sopuli.xyz
            link
            fedilink
            arrow-up
            1
            ·
            1 year ago

            I’d disagree with equating disinfo with spam. Spam seems easier to classify, sites that try to get ahead by having nonsense keywords or whatever and want to sell you something. Dis- or misinfo is trickier, you need to decide what is correct info. Do you understand what I mean?

    • Atemu@lemmy.ml
      link
      fedilink
      arrow-up
      8
      ·
      1 year ago

      StartPage also blocks VPN usage.

      Only accidental I think. They have the option of reporting that you’re behind a VPN proxy when it happens.

      • BrikoX@lemmy.zip
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        They don’t pretent to be googlebot, they use their own crawler they just don’t share the name they use for it, so sites can’t exclude it with robots.txt. They just scrape the same sites that googlebot does, so if the site is excluded by googlebot they also skip it.

    • TrustingZebra@lemmy.one
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      1 year ago

      StartPage also blocks VPN usage.

      Ancedotal but Startpage works perfectly fine with VPN for me. Certainly better than Google, which works but requires a lot of annoying captchas.

      • LinkOpensChest.wav@lemmy.one
        link
        fedilink
        arrow-up
        2
        ·
        1 year ago

        I used Startpage for a long time, and I’m perpetually connected to VPN on both my PC and my phone (different nodes at different times)

        Never had a problem with my VPN

  • 𝕸𝖔𝖘𝖘@infosec.pub
    link
    fedilink
    English
    arrow-up
    55
    ·
    edit-2
    1 year ago

    Interesting that you’re doing a search engine comparison, and not add google into that comparison. Also, there are no sources at all, so we can’t verify any of it, and I know that some of that data is incorrect. Sources would help us (the end user) determine whether our data is incorrect or yours is incorrect due to poor sources. Leaving out the sources, means this chart is actually rather pointless, because it can’t be verified (as correct or incorrect).

    E: also, ignoring cloudflare with this statement and zero explanation, removes author credibility. Either explain exactly why “cloudflare so who cares lol” or don’t include that section at all.

    This chart reminds me of this, which was actually quoted in a presentation as an actual quote…

      • A_Porcupine@lemmy.world
        link
        fedilink
        arrow-up
        16
        ·
        1 year ago

        I couldn’t quite believe the Cloudflare thing, so I loaded up a new Firefox profile, disabled all cookies, and disabled JavaScript and accessed one of my websites that sits behind cloudflare and… It worked just fine.

        Do you have more info on that? Is it only in certain cases?

        • witchdoctor@lemmy.basedcount.comOP
          link
          fedilink
          arrow-up
          8
          ·
          edit-2
          1 year ago

          I believe it’s only when they have anti-ddos enabled or CF thinks you’re a bot, it makes you resolve a captcha (sometimes), and that requires cookies and JS.

        • sloppy_diffuser@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          I get denied enough it is noticeable when I’m on a VPN with Mull. Sometimes it let’s me do a captcha, sometimes its just a straight up block. Usually dropping my VPN fixes.

  • cerement@slrpnk.net
    link
    fedilink
    arrow-up
    30
    ·
    1 year ago

    shouldn’t that category be “SearXNG” instead of “SearX”? – SearX went into maintenance mode a year ago and then archived their code last week – searx.space isn’t even bothering to list SearX instances anymore

        • Nobsi@feddit.de
          link
          fedilink
          arrow-up
          9
          ·
          1 year ago

          Google is the default. How can you say that duckduckgo has good results if you dont compare them to google. Trash diagram.

          • 𝒍𝒆𝒎𝒂𝒏𝒏@lemmy.one
            link
            fedilink
            arrow-up
            2
            ·
            1 year ago

            Fully agree.

            We don’t even know what search query was used either, and what the criteria was used to grade seach engine.

            DDG’s results are perfectly fine to me - however for best results you shouldn’t structure search queries in the same way you would for Google

            IMO trying Google after using ddg for a couple years just shows some big weaknesses in the quality of Google’s results. Fake SEO clone sites et al ☹️

            • Nobsi@feddit.de
              link
              fedilink
              arrow-up
              1
              ·
              1 year ago

              Maybe that’s why ddg doesnt click with me.
              How do i use ddg for technical questions that need some obscure forum posts from 15 years ago? I obly get stackoverflow and windows forums. Those arent helpful at all.

        • rz2000@kbin.social
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          They’re the worst in terms of being the panopticum, but I don’t understand how easy it is to buy data from them.

    • LinkOpensChest.wav@lemmy.one
      link
      fedilink
      arrow-up
      6
      ·
      edit-2
      1 year ago

      I’m not impressed with Kagi. I was lied to by someone at Kagi when I asked a question about their using geo-location data.

      (Well, technically not lied to, but it was clear they were being deliberately evasive and deceptive, which didn’t impress me much, since it’s a paid service I was considering.)

      Edit.

      Obviously, my take may be biased, so I’ve added screenshots from the exchange I had with Kagi, but I’ve blotted out all names for privacy. Even though this left a bad taste in my mouth, I hope I’m not depicting this unfairly, so now you can decide for yourself.

      Edit: If you’re tempted to respond in bad faith, go annoy someone else. I’m not taking the bait, I’ll just block your ass.

      Edit Part 2: Why do all my comments attract the most insufferable neckbeards?

      A. It’s clear why I found it deceptive since he was being a pedant about what constitutes search results (if a widget is summoned by a search term – which didn’t request it btw – then that widget is part of the results. It’s batshit looney to think otherwise)

      B. But I literally posted screenshots for full disclosure and for the sake of honesty – and I’m still getting losers posting cringe in response. Fucking suburbanite straight white male energy stfu

      C. Get blocked, fuckwits. If I wanted your opinion, I’d ask.

      • Dark Arc@social.packetloss.gg
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        1 year ago

        I don’t think that’s (intentionally) deceptive, it seems like two people talking past each other… I’ve been frustrated with customer support at a lot of places, I don’t take it to mean those places are bad though. Good customer support is expensive and hard.

        Thanks for sharing though, I’ll keep that in the back of my mind.

        Edit: I’m also curious why you care if they serve you geolocated results? That might be part of what the support agent was confused by.

        … also maybe tone it down a bit, I don’t think that other guy was trying to bait you and get you all hyped up.

        • LinkOpensChest.wav@lemmy.one
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          I want a search engine that does not use any location data whatsoever to manipulate results because I see it as an extremely problematic practice. For example, someone who lives in my area would be more likely to see agencies and interests that align with fascism, since this is a heavily fascist state.

          This, and it doesn’t seem like a big ask to have a search engine solely respond to deliberate input from the user, so I’m not sure why I need to defend searching for such a thing. The agent could have simply disclosed that they do use locational data to provide their services, and I would have moved on. Instead, he tried to dodge the question. Not only that, but he became very pedantic about what constitutes a “search.” In my interpretation, any widgets or any results whatsoever that use locational data would fall under this umbrella. It is needlessly pedantic to claim that it is something else entirely, since as you can see it was presented to me in response to my entering a keyword, a keyword which I might add did not request a widget at all.

        • Linus_Torvalds@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          While I feel like that in this case it is a non-problem, I could see while someone would like the ability to de-localize search results. Also agree on the rude aspect, thats just unworthy of such a civil discussion.

      • ram@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Legitimately, what part of that was deceptive? They outright stated that those specialized widgets you can’t disable. Your post here is far more misleading in comparison.

        • LinkOpensChest.wav@lemmy.one
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          Why do all my comments attract the most insufferable neckbeards?

          A. It’s clear why I found it deceptive since he was being a pedant about what constitutes search results (if a widget is summoned by a search term – which didn’t request it btw – then that widget is part of the results. It’s batshit looney to think otherwise)

          B. But I literally posted screenshots for full disclosure and for the sake of honesty – and I’m still getting losers posting cringe in response. Fucking suburbanite straight white male energy stfu

          C. Get blocked, fuckwit. If I wanted your opinion, I’d ask.

          • ram@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            1 year ago

            the most insufferable neckbeards

            https://lemmy.one/pictrs/image/b7ad3f91-d781-4085-9757-873ed7e6f4ee.jpeg

            he was being a pedant about what constitutes search results

            You mean they were being precisely accurate

            Fucking suburbanite straight white male energy stfu

            I’m not male

            If I wanted your opinion, I’d ask

            You posted to a public forum, but man you’ve really got an attitude about any contest to what you’ve said.

  • Linus_Torvalds@lemmy.world
    link
    fedilink
    arrow-up
    17
    ·
    1 year ago

    I just love what has become of this thread:

    • Think it’s a nice post
    • Look for Google/Kagi, but they’re missing
    • People ask for sources, realize OP has chart from VERY dodgy conspiracy website
    • People start accusing Kagi Support of lying to their face, Screenshota of convo attached
    • Other users don’t think its a lie, rather a misunderstanding
    • Insults start
    • ?
    • Tibert@compuverse.uk
      link
      fedilink
      arrow-up
      39
      ·
      1 year ago

      Because it doesn’t show the conspiracy theory enhancing the authors conspiracy anti-covid/anti-moon landing opinion :

      meaning you will never find the truth about the moon landing or COVID vaccines there even if the query asks for exactly that. What you will find - though - is a bunch of irrelevant “fact check” or “science loving” sites, or ones shitting on “conspiracy theorists”.

      • Kilgore Trout@feddit.it
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        1 year ago

        Leaving out all other conspiracy theories, since I may agree with some of them, the claim that the moon landing was staged strikes me as mindblowing over everything else. You just need to look at the Moon wath a telescope to disprove it, no need to believe to any scientist.

    • thayer@lemmy.ca
      link
      fedilink
      English
      arrow-up
      32
      ·
      1 year ago

      Cloudflare is becoming entrenched in every aspect of hosting. It’s all fine and dandy until they’re bought by the likes of Google, or Meta.

      • narshee@iusearchlinux.fyi
        link
        fedilink
        arrow-up
        22
        ·
        1 year ago

        I always thought Cloudflare could become shit by itself. I never thought about someone like Google buying them. Governments wouldn’t allow such a monopoly, right, right? oh shit

        • VonReposti@feddit.dk
          link
          fedilink
          arrow-up
          9
          ·
          1 year ago

          It’s kind of a blessing and a curse. The larger a CDN is the more resilient it is to e.g. DDoS attacks which hugely favours Cloudflare. It unfortunately also means if anything happens to Cloudflare most of the internet will go down even though the internet itself should be decentralised by design. What can happen to Cloudflare you might ask. Well anything. Being purchased by someone like Google would be bad for privacy, an incident could force Cloudflare to go down for an undetermined amount of time like what happened to Facebook a while back.

    • cooopsspace@infosec.pub
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      For me it’s that they needlessly centralise the internet, and that’s their goal too.

      Suddenly one data centre goes down and the whole internet will too.

      And data centres do go down, one of Google’s most recent outages happened in an entire region and they were unable to badge into the building because that also relied on Google infrastructure.

  • Adramis [he/him]@beehaw.org
    link
    fedilink
    arrow-up
    9
    ·
    1 year ago

    Are the Ecosia results up to date? They used to be great, but awhile ago they changed something and it’s been hot garbage since. I still use them because trees, but I usually search with Ecosia, don’t see what I want, and then have to use another search engine.

      • AWildMimicAppears@kbin.social
        link
        fedilink
        arrow-up
        69
        ·
        edit-2
        1 year ago

        after looking around on that site, i deeply mistrust the original author about probably everything. using the search term “christchurch shooting was faked” and arguing that the search results attack conspiracy theories, which means that there is censoring going on - that does not fit my definition of sanity.

        e: ah, and the moon landing was fake and covid shots are evil. dudes, this guy is nuts, dont even take the time of the day from him.

        • Tibert@compuverse.uk
          link
          fedilink
          arrow-up
          16
          ·
          edit-2
          1 year ago

          Wtf. Didn’t even have to go too far. Here in the brave section

          meaning you will never find the truth about the moon landing or COVID vaccines there even if the query asks for exactly that. What you will find - though - is a bunch of irrelevant “fact check” or “science loving” sites, or ones shitting on “conspiracy theorists”.

          WTF is wrong with this person.

          This “article” is about spreading search engine for people doing “their own research” and making the US look stupid on TV or something.

          I am for no “censorship”, however sometimes it is needed, because as for the example of the vaccines or moonlanding, people may je mislead, then search s* online and get a trash conspiracy article which enhances that stupid opinion. In this case there needs to be a way to spread good information.

        • JasSmith@kbin.social
          link
          fedilink
          arrow-up
          15
          ·
          1 year ago

          While I don’t agree with his conspiracy theories, search engines should give us the information we are looking for. He asked for information, and some of the search engines effectively told him, “no.” That’s valuable information because it’s not just conspiracy theories they’re removing. For example, some years ago I heard a news report about some American political group called the “Proud Boys.” I wanted to look into them to find out what they’re about, so I Google them. Turns out Google has scrubbed their site from search. Accusations of this kind of political censorship are mounting, too. Another politically contentious site, KiwiFarms, is also delisted. I can only imagine how many other sites have been delisted over the years which we just don’t know about.

          I’m an adult. I can make up my own mind. If I ask for information, I expect a search engine to provide it. Kagi passes this test.

          • Thorned_Rose@kbin.social
            link
            fedilink
            arrow-up
            7
            ·
            edit-2
            1 year ago

            This is my issue too. Yes, there are some things that are absolutely dangerous and some things that are completely nuts. But not all conspiracy theories, for example, are crazy. Some are actual conspiracies. That aside it’s a dangerous precedent to set when someone is picking and choosing what to show or not show and removing the ability of others to decide for themselves.

            Many governments, organisations, companies, etc. can be above board, but they don’t always stay that way. Others are dystopian in their obsession with power and control. Its not always obvious what’s what when censorship and curation of results are going on.

            And frankly, sometimes the ‘facts’ turn out to be wrong. Our reality is that we live in a world where profit and greed drives information and trends, where late stage capitalism leads to more exploitation and all of this is helped by bias, fraud, science for sale and yes, censorship.

            I cannot trust a company or organiation that censors search results because quite simply it means I can’t tell if they’re covering over anything else and what that anything else could be.

            Much like the parable of the boy who cried wolf. You’re either 100% above board and trustworthy or you’re not.

            • JasSmith@kbin.social
              link
              fedilink
              arrow-up
              6
              ·
              1 year ago

              100%. We learned this lesson centuries ago during the Enlightenment. Censorship is harmful to society. Sure, if there were some magical and neutral arbiter of information, maybe it could work if democratically controlled. By there isn’t, and these tools are not democratically controlled. Every time people or groups get too powerful, they abuse the system for their own advantage. We should always presume companies like Google do the same using the age old premise of “protecting the children.” How many violations has this adage defended over the years.

                • Kilgore Trout@feddit.it
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  edit-2
                  1 year ago

                  I still disagree. Arbiters of factual information can’t be companies, and can’t be governments. Currently we don’t have a proper arbiter; I would argue that finding one isn’t “hard”, it’s straight-out impossible.

                  On the same line, who is it up to to decide what does it mean to pursue true knowledge?

                  I strongly believe that censorship is not the answer- it’s not the answer to anything. Let’s say you are in a circle of strangers, and one of them starts shouting to the others that you did something horrible. The solution to this problem is not to kill him, but to present a different source of information that can stand more stable than is (ex: I wasn’t there at that time, I have history of not doing that kind of stuff, you claim this for your own gain, …).

                  The solution to ignorance is not to shut down dissident opinions or theories, as flawed or dangerous as they may be, but to be open to educate.

                  In this specific instance pertaining to search engines, the correct way to make misinformation available would be to provide appropriate disclaimers with reputable and independent sources, not to censor.

  • nyakojiru@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    7
    ·
    1 year ago

    There is something that is irrefutable that sadly google has the best algorithm and most crawled information. So it has by far the best results using it correctly with parameters. Sometimes I fall to use it but i take my precautions like in a separate container using Firefox Multi account containers and some other stuff