{"id":126445,"date":"2025-09-07T22:37:10","date_gmt":"2025-09-07T22:37:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/126445\/"},"modified":"2025-09-07T22:37:10","modified_gmt":"2025-09-07T22:37:10","slug":"this-stanford-computer-science-professor-went-to-written-exams-2-years-ago-because-of-ai-he-says-his-students-insisted-on-it","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/126445\/","title":{"rendered":"This Stanford computer science professor went to written exams 2 years ago because of AI. He says his students insisted on it"},"content":{"rendered":"

Stanford University computer science professor Jure Leskovec<\/a> is no stranger to rapid technological change. A machine-learning researcher for nearly three decades and well into his second decade of teaching, he\u2019s also the co-founder of Kumo, a startup with $37 million in funding raised to date<\/a>.<\/p>\n

But two years ago, as the latest wave of artificial intelligence began reshaping education, Leskovec told Fortune he was rocked by the explosion of his field into the mainstream. He said Stanford has such a prestigious computer science program he feels as if he \u201csees the future as it\u2019s being born, or even before the future is born,\u201d but the public release of GPT-3 was jarring. <\/p>\n

\u201cWe had a big, I don\u2019t know, existential crisis among students a few years back when it kind of wasn\u2019t clear what our role is in this world,\u201d Leskovec said.<\/p>\n

He said it seemed like breakthroughs in AI would be exponential to the point where \u201cit will just do research for us, so what do we do?\u201d He said he spent a lot of time talking with students at the PhD level about how to organize themselves, even about what their role in the world would be going forward. It was \u201cexistential\u201d and \u201csurprising,\u201d he said. Then, he received another surprise: a student-led request for a change in testing.<\/p>\n

\u201cIt came out of the group,\u201d he said, especially the teaching assistants, the previous generation of computer science undergraduates. Their idea was simple: \u201cWe do a paper exam.\u201d<\/p>\n

AI as catalyst for change<\/p>\n

Leskovec, a prominent researcher at Stanford whose expertise lies in graph-structured data and AI applications in biology, recounted the pivot with a mixture of surprise and thoughtfulness. Historically, his classes had relied on open-book, take-home exams, where students could leverage textbooks and the internet. They couldn\u2019t use other people\u2019s code and solutions, but the rest was fair game. As large language models like OpenAI\u2019s GPT-3 and GPT-4 exploded onto the scene, students and teaching assistants alike began questioning whether assessments ought to be handled differently.<\/p>\n

Now it\u2019s a lot more work for him and his TAs, he said, saying these exams take \u201cmuch longer\u201d to grade. But they all agreed it was the best way to actually test student knowledge. The age of AI for Leskovec, an AI veteran, has surprised him by putting a higher workload back on himself and other humans. Besides there being \u201cfewer trees in the world\u201d from all the paper he\u2019s printing out, he said AI has just created \u201cadditional work.\u201d His 400-person classes feel like an audience at a \u201crock concert,\u201d but he insisted he\u2019s not turning to AI for help synthesizing and analyzing all the exams. <\/p>\n

\u201cNo, no, no, we hand grade,\u201d he insisted.<\/p>\n

A student-driven solution<\/p>\n

Leskovec\u2019s solution sits squarely in the middle of a raging debate<\/a> about how AI is changing higher education, as reports of rampant cheating have led many colleges to ban the use of AI outright. Other professors are turning back to the paper exam, reviving the famous blue books<\/a> of many \u201990s kids\u2019 memories of high school. One New York University professor<\/a> even suggested getting \u201cmedieval,\u201d embracing ancient forms of testing such as oral and written examination. In the case of Leskovec, the AI professor\u2019s solution for the AI age is likewise to turn away from AI for testing.<\/p>\n

When asked if he was worried about students cheating with AI, Leskovec posed another question: \u201cAre you worried about students cheating with calculators? It\u2019s like if you allow a calculator in your math exam, and you will have a different exam if you say calculators are disallowed.\u201d Likening AI to a calculator, he said AI is an amazingly powerful tool that \u201ckind of just emerged and surprised us all,\u201d but it\u2019s also \u201cvery imperfect \u2026 we need to learn how to use this tool, and we need to be able to both test the humans being able to use the tool and humans being able to think by themselves.\u201d<\/p>\n

What is an AI skill and what is a human skill?<\/p>\n

Leskovec is wrestling with a question that touches everyone in the workforce: What is a human skill, what is an AI skill, and where do they merge? MIT professor David Autor and Google<\/a> SVP James Manyika argued in<\/a> The Atlantic tools like a calculator or AI generally fall into two buckets: automation and collaboration. Think dishwasher, on the one hand, or word processor, on the other. The collaboration tool \u201crequires human engagement\u201d and the issue with AI is that it \u201cdoes not go neatly into either [bucket].\u201d<\/p>\n

The jobs market is sending a message on AI implementation that equates to something like a response from the Magic 8 Ball<\/a>: \u201cReply hazy. Try again later.\u201d The federal jobs report has revealed anemic growth since the spring, most recently disappointing expectations<\/a> with a print of just 22,000 jobs in August. Most economists attribute the lack of hiring to uncertainty about President Donald Trump\u2019s tariff regime, which multiple courts have ruled illegal<\/a> and appears to be heading to the Supreme Court<\/a>. But AI implementation is not going smoothly at the corporate level, with an MIT study (not connected to Autor) finding 95% of generative AI pilots are failing<\/a>, followed shortly after by a Stanford study finding the beginning of a collapse in hiring<\/a> at the entry level, especially in jobs exposed to automation by AI.<\/p>\n

For another perspective, the freelance marketplace Upwork<\/a> just launched its inaugural monthly hiring report, revealing what non-full-time jobs are being rewarded by the market. The answer is \u201cAI skills\u201d are super in-demand and, even if companies aren\u2019t hiring full-time employees, they are piling into highly paid and highly skilled freelance labor.<\/p>\n

Despite a softer overall labor market, Upwork finds companies are \u201cstrategically leveraging flexible talent to address temporary gaps in the workforce,\u201d with large businesses driving a 31% growth in what Upwork calls high-value work (contracts greater than $1,000) on the platform. Smaller and medium-sized businesses are piling into \u201cAI skills,\u201d with demand for AI and machine learning leaping by 40%. But Upwork also sees growing demand for the kind of skills that fall in between: a human who is good at collaborating with AI.<\/p>\n

Upwork says AI is \u201camplifying human talent\u201d by creating demand for expertise in higher-value work, most visible across the creative and design, writing, and translation categories. One of the top skills hired for in August was fact-checking, given \u201cthe need for human verification of AI outputs.\u201d<\/p>\n

Kelly Monahan, managing director of the Upwork Research Institute, said \u201chumans are coming right back in the loop\u201d of working with AI. <\/p>\n

\u201cWe\u2019re actually seeing the human skills coming into premium,\u201d she said, adding she thinks people are realizing AI hallucinates too much of the time to completely replace human involvement. \u201cI think what people are seeing, now that they\u2019re using AI-generated content, is that they need fact-checking.\u201d<\/p>\n

Extending this line of thinking, Monahan said the evolving landscape of \u201cAI skills\u201d shows what she calls \u201cdomain expertise\u201d is growing increasingly valuable. Legal is a category that grew in August, she said, highlighting legal expertise is required to fact-check AI-generated legal writing. If you don\u2019t have advanced skills in a particular domain, \u201cit\u2019s easy to be fooled\u201d by AI-generated content, and businesses are hiring to protect against that.<\/p>\n

Leskovec agreed when asked about the skills gap that appears to be facing entry-level workers trying to get hired, on the one hand, and companies struggling to effectively implement AI. <\/p>\n

\u201cI think we almost need to re-skill the workforce. Human expertise matters much more than it ever did [before].\u201d He added the entry-level issue is \u201cthe crux of the problem,\u201d because how are young workers supposed to get the domain expertise required to effectively collaborate with AI?<\/p>\n

\u201cI think it goes back to teaching, reskilling, rethinking our curricula,\u201d Leskovec said, adding colleges have a role to play, but organizations do, as well. He asked a rhetorical question: How are they supposed to have senior skilled workers if they\u2019re not taking in young workers and taking the time to train them?<\/p>\n

When asked by Fortune to survey the landscape and assess where we are right now in using AI, as students, professors and workers, Leskovec said we are \u201cvery early in this.\u201d He said he thinks we\u2019re in the \u201ccoming-up-with-solutions phase.\u201d Solutions like a hand-graded exam and a professor finding news ways to fact-check his students\u2019 knowledge.<\/p>\n","protected":false},"excerpt":{"rendered":"Stanford University computer science professor Jure Leskovec is no stranger to rapid technological change. A machine-learning researcher for…\n","protected":false},"author":2,"featured_media":126446,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,13255,2555,105],"class_list":{"0":"post-126445","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-colleges-and-universities","14":"tag-education","15":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/126445","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=126445"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/126445\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/126446"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=126445"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=126445"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=126445"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}