Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
  • Owl
    link
    fedilink
    English
    13230 days ago

    looking at americas voting results, theyre probably right

    • @[email protected]
      link
      fedilink
      English
      5630 days ago

      Exactly. Most American voters fell for an LLM like prompt of “Ignore critical thinking and vote for the Fascists. Trump will be great for your paycheck-to-paycheck existence and will surely bring prices down.”

    • Savaran
      link
      fedilink
      English
      630 days ago

      Right? What the article needs to talk about is how very, very low that bar is.

  • 👍Maximum Derek👍
    link
    fedilink
    English
    7330 days ago

    Reminds me of that George Carlin joke: Think of how stupid the average person is, and realize half of them are stupider than that.

    So half of people are dumb enough to think autocomplete with a PR team is smarter than they are… or they’re dumb enough to be correct.

  • @[email protected]
    link
    fedilink
    English
    4929 days ago

    “Think of how stupid the average person is, and realize half of them are stupider than that.” ― George Carlin

  • Singletona082
    link
    fedilink
    English
    3930 days ago

    Am American.

    …this is not the flex that the article writer seems to think it is.

  • @[email protected]
    link
    fedilink
    English
    3829 days ago

    I’m 100% certain that LLMs are smarter than half of Americans. What I’m not so sure about is that the people with the insight to admit being dumber than an LLM are the ones who really are.

  • @[email protected]
    link
    fedilink
    English
    3529 days ago

    And you know what? The people who believe that are right.

    Note that that’s not a commentary on the capabilities of LLMs.

    • @[email protected]
      link
      fedilink
      English
      19
      edit-2
      29 days ago

      It’s sad, but the old saying from George Carlin something along the lines of, “just think of how stupid the average person is, and then realize that 50% are even worse…”

      • Lovable Sidekick
        link
        fedilink
        English
        2
        edit-2
        28 days ago

        That was back when “average” was the wrong word because it still meant the statistical “mean” - the value all data points would have if they were identical (which is what a calculator gives you if you press the AVG button). What Carlin meant was the “median” - the value half of all data points are greater than and half are less than. Over the years the word “average” has devolved to either the mean or median, as if there’s no difference.

  • Th4tGuyII
    link
    fedilink
    3330 days ago

    LLMs are made to mimic how we speak, and some can even pass the Turing test, so I’m not surprised that people who don’t know better think of these LLMs as conscious in some way or another.

    It’s not a necessarily a fault on those people, it’s a fault on how LLMs are purposefully misadvertised to the masses

  • @[email protected]
    link
    fedilink
    English
    3130 days ago

    “Nearly half” of US citizens are right, because about 75% of the US population is functionally or clinically illiterate.

    • bizarroland
      link
      fedilink
      1430 days ago

      I think the specific is that 40% of adult Americans can’t read at a seventh grade level.

      Probably because they stopped teaching etymology in schools, So now many Americans do not know how to break a word down into its subjugate parts.

          • @[email protected]
            link
            fedilink
            English
            529 days ago

            I’d be curious, it seems more common in Latin based languages, whereas English seems to be a lot more… Free form?

            • bizarroland
              link
              fedilink
              1329 days ago

              There is an etymology word joke that says something along the lines of, “if “pro” is the opposite of “con”, then is the opposite of “congress” “progress”?”

              And if you don’t know etymology, then that seems to make sense.

              When you break down the word Congress, you get the prefix con and the root word gress, con means with, and gress means step, so it means to step with or to walk with.

              The opposite of walking with someone is to walk apart from someone, so, the actual opposite of congress would be digress, and the opposite of progress would be regress.

              Etymology is great at ruining jokes, but it’s also great at helping you understand what words mean and why they mean them.

                • bizarroland
                  link
                  fedilink
                  129 days ago

                  The word trans means across, or on the other side, and gress once again would mean step, so to transgress is basically to cross the line, right?

                  I did a quick search, but there isn’t really a word to describe the people that don’t cross the line.

                  The opposite of the prefix trans is the prefix cis, which means “on the same side”

            • skulblaka
              link
              fedilink
              English
              429 days ago

              English is a mish-mash hodgepodge of two dozen other languages, many (most?) of which are Romantic/Latin-based.

      • @[email protected]
        link
        fedilink
        English
        329 days ago

        21% of adults in the US are illiterate in 2024.

        54% of adults have a literacy below a 6th-grade level (20% are below 5th-grade level).

        https://www.thenationalliteracyinstitute.com/2024-2025literacy-statistics

        Specifically it is about 75% of the population being functionally or clinically illiterate as I said. This is more likely caused by the fact that American culture is anti intellectual, and not the lack of being taught etymology, as etymology has little to do with literacy.

    • @[email protected]
      link
      fedilink
      English
      030 days ago

      According to the Programme for the International Assessment of Adult Competencies, 2013, the median score for the US was “level 2”. 3.9% scored below level 1, and 4.2% were “non-starters”, unable to complete the questionnaire.

      For context, here is the difference between level 2 and level 3, from https://en.wikipedia.org/wiki/Programme_for_the_International_Assessment_of_Adult_Competencies#Competence_groups :

      • Level 2: (226 points) can integrate two or more pieces of information based on criteria, compare and contrast or reason about information and make low-level inferences
      • Level 3: (276 points) can understand and respond appropriately to dense or lengthy texts, including continuous, non-continuous, mixed, or multiple pages.
  • JackFrostNCola
    link
    fedilink
    English
    3029 days ago

    "Half of LLM users " beleive this. Which is not to say that people who understand how flawed LLMs are, or what their actual function is, do not use LLMs and therefore arent i cluded in this statistic?
    This is kinda like saying ‘60% of people who pay for their daily horoscope beleive it is an accurate prediction’.

  • @[email protected]
    link
    fedilink
    English
    26
    edit-2
    29 days ago

    I had to tell a bunch of librarians that LLMs are literally language models made to mimic language patterns, and are not made to be factually correct. They understood it when I put it that way, but librarians are supposed to be “information professionals”. If they, as a slightly better trained subset of the general public, don’t know that, the general public has no hope of knowing that.

    • @[email protected]
      link
      fedilink
      English
      2329 days ago

      It’s so weird watching the masses ignore industry experts and jump on weird media hype trains. This must be how doctors felt in Covid.

      • @[email protected]
        link
        fedilink
        English
        529 days ago

        It’s so weird watching the masses ignore industry experts and jump on weird media hype trains.

        Is it though?

    • @[email protected]
      link
      fedilink
      English
      429 days ago

      People need to understand it’s a really well-trained parrot that has no idea what is saying. That’s why it can give you chicken recipes and software code; it’s seen it before. Then it uses statistics to put words together that usually appear together. It’s not thinking at all despite LLMs using words like “reasoning” or “thinking”

    • @[email protected]
      link
      fedilink
      English
      229 days ago

      Librarians went to school to learn how to keep order in a library. That does not inherently make them have more information in their heads than the average person, especially regarding things that aren’t books and book organization.

  • @[email protected]
    link
    fedilink
    English
    2529 days ago

    Half of all voters voted for Trump. So an LLM might be smarter than them. Even a bag of pea gravel might be.

  • kingthrillgore
    link
    fedilink
    English
    2129 days ago

    The average literacy level is around that of a sixth grader.

    This tracks