cross-posted from: https://hexbear.net/post/9348639

The Generative AI Learning Penalty: Evidence from Chinese Secondary Education

Using 30 months of panel data on 26,811 Chinese students in grades 7-12, we study how generative AI affects homework productivity and learning. The data combine monthly closed-book exams, high-school and college entrance exams, and homework scores and completion time across nine subjects. We exploit staggered AI adoption in a difference-in-differences design. AI adoption raises homework scores by 18% and reduces completion time by 30%, but lowers monthly exam scores by 20% within six months. High-stakes entrance-exam scores fall by 18 and 24%, with the full penalty emerging only after about two years. The losses are largest in social science subjects, followed by STEM and languages, and are especially large for junior students, high-achieving students, and boys. The learning losses are concentrated among roughly 80% of AI users whose behavior is consistent with homework outsourcing, as indicated by exceptionally short homework completion time coupled with high homework scores. AI users who maintain similar homework completion time as non-AI users experience small learning losses.

  • Orcinus@lemmygrad.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    12 days ago

    It is. But it’s apparently how China does things and they produce the most accomplished scientists nowadays, people who are actively saving the world in the long term. I wonder if it’s because of or in spite of homework. What variables influence this?

      • Orcinus@lemmygrad.ml
        link
        fedilink
        English
        arrow-up
        1
        ·
        12 days ago

        Individually, you are right. But one could argue that in seige countries, being productive and accomplished means the difference between being a resilient socialist state and succumbing to imperialist powers. On the other hand, I think studies have shown that people are at their most productive when working hours are short. But diminishing returns are still returns. I don’t know. But I’m looking forward to the fall of the empire because it means other countries can relax their guard.