I find it pretty interesting that kagi is rated as Terrible search engine, even ChatGPT preforms better.

  • morrowind@lemmy.ml
    link
    fedilink
    English
    arrow-up
    56
    arrow-down
    1
    ·
    9 months ago

    This has been posted before, he has some weird criteria and no one has been able to replicate his kagi results

  • filister@lemmy.world
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    4
    ·
    edit-2
    9 months ago

    What a huge wall of text, so horribly formatted using a very ineligible font and it looks awful on the phone.

    Plus it is kind of dumb to measure search engines based on such a low number of queries. You are introducing a huge bias and the generated search results are ranked by a single person also introducing his own bias. The idea is interesting the execution not so much.

    • cyruseuros@lemmy.ml
      link
      fedilink
      English
      arrow-up
      10
      ·
      9 months ago

      Idk, doing this “properly” would take an immense amount of effort and manpower. This feels more like a “let me get enough info for an educated guess” EDA process, which still seems to have taken a lot of effort and I appreciate it a lot.

      • akrot@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        9 months ago

        But basing a recommendation on a ballpark anectdotal evidence is eidiculous.

        • cyruseuros@lemmy.ml
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 months ago

          Did he actually recommend one? That said, it’s obvious the author favors Marginalia personally, but there’s no point pretending they don’t have biases. At least for me, making them obvious helps.

  • firebyte@lemmy.world
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    5
    ·
    9 months ago

    I was skeptical at first though let me tell you, Kagi is so much better. I get exact search terms, which is immensely useful as a programmer, rather than providing results for what Google thinks I want to search for. It’s also really, really nice not seeing ads as search results anymore, ad blocker or no ad blocker.

    Is it as comprehensive as Google search? It meets about 95-96% of my needs. I still use Google very infrequently for some really obscure domain specific searches if Kagi doesn’t find anything useful, though that’s getting rarer and rarer.

    It’s also easy to block AI generated sites that pop up providing just enough likeness, but really are regurgitated AI trash, or are ‘Wikipedia clones’.

    I have no financial interest in Kagi, other than paying to use it. It has certainly been worth it for me.

    • plixel@programming.dev
      link
      fedilink
      English
      arrow-up
      4
      ·
      9 months ago

      I really liked Kagi at first, especially since I use it mainly for programming as well, but recently I feel like the quality has gone downhill. Right around the time they integrated the Brave stuff I’ve noticed a significant amount of me having to scroll down past the usual Google-like fluff results before getting to actually relevant information. It’s a little sad to see because when I first used it, it was so good now it basically feels like a skinned Google-lite at this point. I’m still a customer but only because I haven’t found a good alternative yet.

    • MudMan@kbin.social
      link
      fedilink
      arrow-up
      31
      arrow-down
      1
      ·
      edit-2
      9 months ago

      It depends. Chatbots are terrible at broad queries or parsing very detailed information, but they’re surprisingly good with very fuzzy searches. If I want a link to a specific website I go to a search engine. If I want to ask “hey, what’s that 80s horror comedy that’s kinda like Gremlins but not Gremlins and it has one of the monsters coming out of the toilet in the poster?” I go to a chatbot.

      EDIT: Heh. Just for laughs, I tried that exact query on Perplexity.ai. It got it right:

      The movie you are referring to is “Ghoulies.” It is a 1984 horror comedy film that features small, impish creatures similar to those in Gremlins. One of the iconic images associated with the movie is a Ghoulie coming out of a toilet, which is also featured on the poster.

      • EldritchFeminity@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        8
        ·
        9 months ago

        I find this fascinating because that seems like the most difficult of the 3 to do for a normal search engine and sounds like an incredibly useful tool, but everybody and their mother seems to only care about whether it can do the other 2 or if you can trick it into spilling military secrets.

        • MudMan@kbin.social
          link
          fedilink
          arrow-up
          5
          ·
          9 months ago

          Well, yeah. So much of this conversation has gotten really dumb, with both advocates and detractors misrepresenting the tech and its capabilities and applying it to the wrong uses and applications as a result.

          Honestly, early on I did think as a summary service for search queries it’d be more useful than it ended up being. It quickly became obvious that without the search results onscreen you basically have to fact check every piece of info you get, so it’s only really useful to find answers you already know but had forgotten or that you need a source for.

          But hey, at least I noticed that it kinda isn’t before I built it as a key part of Windows. At this point if I was going to build a search app around this tech I’d use it for a short summary to replace Google’s little blurb cards and still give you the raw results immediately below. It’s only really good at parsing a wonky search prompt into a more accurate query. That’s why when I have to use one of these I go to Perplexity instead of raw ChatGPT or Bing or whatever, it’s the one that’s built the most like that, although you still end up having to argue with it when it insists on being wrong and gets sidetracked by its own mistakes.

    • nucleative@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      1
      ·
      9 months ago

      I use it as an answer engine. Queries like: what’s that css property for xyz, or please summarize this email, or give me the top 25 most commonly used color words in English in a json schema like this.

      All of that could be found with a normal search engine but I’d have to work harder and sort through a lot of trash along the way.

      ChatGPT just understands what I’m looking for almost no matter how poorly worded my query is and just answers the question.

      • lemmyvore@feddit.nl
        link
        fedilink
        English
        arrow-up
        8
        ·
        9 months ago

        please summarize this email

        As long as you realize they store and use that email.

    • SGG@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      9 months ago

      It’s a whatever question you ask engine. You can ask for the information directly and/or ask for sources to back it up.

    • podperson@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      ·
      9 months ago

      Interesting responses here - perhaps I’ll add it to my daily rotation as a science experiment.

    • Imgonnatrythis@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      9 months ago

      More and more yes. You often get an answer without having to link out to some bullshit site with ads everywhere. It’s often pretty clean and precise.

  • Imgonnatrythis@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    2
    ·
    9 months ago

    What a painful read. Search results will vary to a degree based on your profession and interests. Personally I haven’t found anything that beats Kagi and the UI is too notch which matters to me since I use search quite a bit.

  • qaz@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    6
    ·
    edit-2
    9 months ago

    The queries are:

    download youtube videos

    ad blocker

    download firefox

    Why do wider tires have better grip?

    Why do they keep making cpu transistors smaller?

    vancouver snow forecast winter 2023

    A sample size of 6? This is useless.

  • BentiGorlich@gehirneimer.de
    link
    fedilink
    arrow-up
    14
    arrow-down
    1
    ·
    9 months ago

    I am happy with kagi, so… But I abondoned google a long time ago and basically switched from DuckDuckGo to Kagi

  • maegul (he/they)@lemmy.ml
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    2
    ·
    edit-2
    9 months ago

    Anyone else wonder if Dan Luu’s stuff is ever worth the read? Generally I’m interested in what he talks about and has to say, but every article/post of his gives me serious info dump vibes. And sure, I like deep dives and long form as much, even today, but I with his content I’m always feeling like I didn’t need to read all of this and that he just likes writing a lot. Anyone else? Not I didn’t bother reading this one because it definitely seemed not worth it.

    • Aedis@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      9 months ago

      At least what I see with this experiment/article is that is overly verbose, he takes a long time to get to the point. And then when he does his methodology shows an experiment that cannot be verified. Even when something is “subjective” we can still draw conclusions from it if we set up proper non-subjective ways of evaluating the results we see (ie. Rubrics). The fact that he doesn’t really say what leads him to say in detail what is a “terrible/v. bad/bad/good result” is a massive red flag in his method.

      After seeing that, I no longer read the rest of it. Any conclusions drawn from a flawed methodology are inherently fallacies or hearsay.

      If in any case it is further explained in the article and that somehow refutes what I’ve postulated later on, then I would have to say that the article is poorly written.

      All this to say… I agree with you, not worth the read.

      • iopq@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        9 months ago

        The entire post is exact details for why he decides each rating for each query

        • Z4rK@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          9 months ago

          No it isn’t. He for example evaluate that Kagi and Marginalia get the same score if you have to read as far down as to the 10th result for Kagi, while Marginalia has no answer. How is that the same score? There is no explanation. There is a lot of text, and then in the end he has made some subjective choices.

      • maegul (he/they)@lemmy.ml
        link
        fedilink
        English
        arrow-up
        5
        ·
        9 months ago

        I’m not shitting on it, just sharing my impression and arguably prejudice of his work and asking if anyone has shared or different perspectives. I’m very happy with the idea that his work is good and enjoyed by many (by all means he seems to have a healthily strong patreon following).

  • Telodzrum@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    4
    ·
    9 months ago

    Marks who are getting swindled into paying for a bad product sold by a bad dude are real upset in these comments.

      • HenriVolney@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        2
        ·
        9 months ago

        Well, my bad. Anyway, I can’t make it work with Firefox focus. The search results analysis is still relevant though. I miss the early days of light fast clean Internet search

  • finthechat@kbin.social
    link
    fedilink
    arrow-up
    12
    arrow-down
    20
    ·
    9 months ago

    I am both joking and being serious when I say this: the engine doesn’t matter, it’s a skill issue.

    • Blue_Morpho@lemmy.world
      link
      fedilink
      English
      arrow-up
      35
      ·
      edit-2
      9 months ago

      It’s not 2010 anymore. Google has removed or ignores most regex that used to make it work well. It’s not a skill issue. You can’t make the queries you used to be able to do.

    • bleistift2@feddit.de
      link
      fedilink
      English
      arrow-up
      14
      ·
      edit-2
      9 months ago

      Recently I saw a meme or post or tweet that I can’t find anymore. The gist was: In the 2000s, search engines were arcane tools which could only be used competently by few select people. Nowadays this has changed. Not because people have gotten smarter, but because search engines were dumbed down so much that it’s not possible to use them competently anymore.

      • Plopp@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        9 months ago

        Right? I feel the same about much of software design as well. Been a computer nerd my whole life and it’s never been more difficult to use them competently than it currently is. Incredibly frustrating.

    • Doolbs@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      9 months ago

      I use Google a lot, and I don’t have any problems finding relevant results. But, then again again I do a lot of site searches: site:edu, site: gov. Or, even narrowing down more doing a site search like: site:jstor.org; a lot better than being SEO blinded by doing a general Google search.___