You Don’t Need an AI Policy — You Need Two (guest post)


What will tell your students about whether and how they may use AI for work you assign?

It depends on the students, right?

That’s the main idea behind today’s guest post by Victor Kumar (Boston University). Professor Kumar is co-author (w/Richmond Campbell) of A Better Ape (OUP, 2022). In addition to his academic work, he writes about philosophy, teaching, and society at his blog, Open Questions.

“To capitalize on the benefits of AI and avoid the risks, teachers must craft two AI policies: one for classes where most of the students will exploit any available shortcuts, and another for classes where most of the students won’t,” Kumar writes.

He’s teaching an intro-level course and an upper-level course this term, and in what follows he shares elements of the different approaches to student AI use he is taking in them.


You Don’t Need an AI Policy. You Need Two.

One policy to preserve the take-home essay, another to explore the frontiers of education

by Victor Kumar

Many university professors (like me) are worried that AI will short-circuit learning. By outsourcing written assignments to LLMs like ChatGPT or Claude, students avoid thinking for themselves. If we don’t curb this practice, they’ll learn nothing in our courses, and the value of a university education will collapse.

Yet others (also me) argue that AI—when used properly—accelerates learning. Like other information technologies that once seemed threatening but ultimately proved invaluable, LLMs scaffold cognition and allow users to ascend to new intellectual heights. We just need to figure out how to unlock this potential in our classrooms.

So who’s right?

Both are. (I’m right twice over.) The same technology that threatens cognitive atrophy also promises to nurture intellectual growth.

You might search for a single AI policy that minimizes the odds of degrading student learning and maximizes the odds of enhancing it. Yet it’s impossible to devise take-home assignments that students won’t game with AI. Ask students to have an LLM generate an essay and then critique it themselves? Some will just outsource the critique as well.

To capitalize on the benefits of AI and avoid the risks, teachers must craft two AI policies: one for classes where most of the students will exploit any available shortcuts, and another for classes where most of the students won’t.

Think, paradigmatically, about non-majors in lower-level, general-education courses who may never take another course in the subject again vs. majors in upper-level courses who are enthusiastic about the subject and are considering graduate programs or related professional degrees. The distinction isn’t quite so neat; which category your students fall into isn’t fixed in stone. A good teacher may be able to coax students into the responsible camp.

Once you’ve sized up your class, you deploy one of two policies. For the opportunists, you eliminate the possibility of benefiting from AI. For the enthusiasts, you assume most won’t outsource, guide them toward constructive uses of AI, and invite them to discover their own.

For the Opportunists

Obviously, you can’t rely on opportunists to abstain voluntarily. Nor should you constantly play cop. Professors can’t reliably detect AI-generated essays anyway, which now easily earn Bs or higher.

Yes, you can spot obvious slop and use context clues—a fluid and knowledgeable essay from a student who stumbles through classroom discussion—but you’re going to miss most cases and, worse, falsely accuse innocent students. As Henry Shevlin quips, to think otherwise is to fall prey to the toupee fallacy: “noticing only the bad cases, oblivious when it’s convincing.” Studies consistently reveal unreliable detection and overconfidence. Those who use LLMs for writing tasks frequently are an exception to this rule, but only a tiny sliver of humanities instructors fall into this category.

What’s more, the savviest students aren’t even asking LLMs to write essays outright. They’re asking for outlines and refinements—writing the essay themselves but letting AI shoulder 90% of the intellectual load. Trying to spot such essays is a fool’s errand.

Some throw up their hands and conclude that the only option is to replace essays with exams. This would be a shame. Slow, patient writing is the highest form of thinking in the humanities. And there’s a superior alternative: low-stakes essays that train students to excel on exams.

Here’s how I’m implementing this strategy with eighty students in my Intro Ethics course this Fall.

As usual, I’ll assign short, weekly take-home essays (max 300 words), but this time with a twist: students will begin writing them in class before revising them at home (worth 20% of their final grade). I’ll grade them for completion only, minimizing my workload and reducing the incentive to cheat. But I’ll also give three in-class essay exams (60%), where students write short essays identical to their weekly take-homes—the idea being that by writing the essays themselves, they’ll do better on the exams.

Foolproof, right? No, obviously. Some students cheat not for grades but to avoid thinking. But only some; to believe otherwise is far too cynical and sells students short. Plus, I care more about the learners than the cheaters—as we all should. And the goal is to encourage some students to learn who might otherwise cheat, shifting behavior at the margins.

The policy isn’t perfect, but it’s better than the alternatives. Compared to switching entirely to exams, it preserves opportunities for deep thinking. Another strength is that it doesn’t matter much if some students cheat. I’m increasing participation credit from 10% to 20%, so 80% of their grade is LLM-proof anyway.

One challenge remains: convincing students that writing the essays will help them on the exams. Honestly, I’m not certain it will! But I’ll make my case, explaining a basic premise of our discipline—in essence, that you never understand anything as thoroughly as when you transcribe, revise, and clarify (indeed create) your thoughts. That’s all they need to do to prepare for the exams, during which I’ll hand out copies of the relevant articles, so no need to memorize or cram.

For the Enthusiasts

That covers the opportunists. What about the enthusiasts? The students you can trust to engage with ideas for their own sake, motivated by the pleasure of thinking? For classes where they predominate, my script flips.

I won’t require them to use AI (unlike some daring souls), but I do want to show them how it can scaffold their thinking. They don’t need me, a middle-aged professor, to teach them basic AI literacy. But helping them become good researchers and writers is precisely my job; the people who excel at these tasks in the future won’t be those who work solo or simply outsource (contrary to what some suggest) but, rather, those who skillfully integrate their knowledge with AI tools. I want the people filling tomorrow’s professional roles to know some philosophy. And while some students are already using AI in ways I’ve never dreamed of, most don’t yet know how to harness AI to enrich their intellects.

To truly grasp AI’s potential, academics must stop viewing it solely through the lens of plagiarism detection. AI is not a player piano; it’s a choose-your-own- adventure research book. At least, it can be, provided you have an intuitive sense of when it’s reliable—for common knowledge rather than obscure particulars—and double-check when there’s any doubt. Know what’s at stake: “foregoing ChatGPT might save you from one error, but you’ll forfeit a hundred truths.”

As a researcher, you can use AI to hunt for sources, produce summaries of well-worn topics, and generate examples. Some uses invite ethical scrutiny. Some require caution. Take brainstorming: it’s worth consulting an LLM to spark ideas, but exhaust your own ideas first. Otherwise, as Ethan Mollick warns, you risk crowding out your own creativity and surrendering intellectual agency.

If a book is potentially relevant to your research but you lack the time or interest to read the entire thing, you can upload it and ask the LLM where it covers your topic, then dive into the pages it flags. Unlike a book, you can fire follow-up questions at it tailored to your interests, background, and knowledge (or lack thereof). Elsewhere, I write:

As with other cognitive-enhancing information technologies, the key is interactive engagement that upgrades cognitive functioning—rather than one-shot prompting. Each exchange should deepen your understanding, leading you to synthesize information and refine your inquiry.

You can also solicit feedback on arguments, though you mustn’t defer; you have to make the call yourself about whether the ideas are any good. AI is blind without IA—intellectual autonomy.

In my upper-level course this Fall, we’ll mostly do what we usually do: Socratic dialogue, sparked by their critical reactions to the readings. But we’ll also carve out class time to use AI constructively, as a model for what to do on their own.

We’ll craft Deep Research queries to generate literature surveys—warning them to take these with a grain of salt since the real value lies in the primary sources it uncovers. We’ll feed arguments into the system and solicit criticism, evaluating for ourselves which hit the mark and which miss. Eventually, we’ll submit drafts for writing feedback.

Experiment, Observe, Share

These are just starting points—I’m hardly the most qualified guide. But I can learn. I’ll seek out ideas from professors like Gus Skorburg, who is developing a course that trains students “to use AI to learn rather than avoid learning.” I also expect students to generate ideas I haven’t thought of.

Eventually, social scientists will study the effects of different AI policies and produce hard evidence about the advantages and tradeoffs. Until then, we should think carefully and adopt whatever policies strike us as effective—even if radically different from mine—and report our experiences afterward. Share on social media, email your department listservs, or (like me) start a blog.

Too many academics hold firm beliefs about LLM capabilities while having barely interacted with the technology. Informed decisions demand first-hand knowledge. It doesn’t take much—you can quickly gain competence by “inviting AI to the table” on whatever you happen to be working on. You could even start by running your draft AI policy past ChatGPT.

guest

25 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Nick
Nick
11 months ago

“The policy isn’t perfect, but it’s better than the alternatives. Compared to switching entirely to exams, it preserves opportunities for deep thinking.”

Why are these the only options? Why is Socratic dialogue available to our upper-year students but not to our lower-level ones? Surely verbal/debate-based assessment can also be implemented in many lower-level courses. I urge everyone to think creatively here.

“What about the enthusiasts? The students you can trust to engage with ideas for their own sake, motivated by the pleasure of thinking? For classes where they predominate, my script flips.”

And do we just accept, as a condition of our employment, that we will be grading lots of AI-generated essays in these classes as well? Even if it’s (optimistically) just 5/25 submissions, perhaps 20 total per class? That per semester we will be sitting down and pouring our scholarly and pedagogical energy into 40 essays written by robots built by profiteering sociopaths?

Obviously the benefits here for the 20/25 may outweigh this consideration. But I thought I’d make sure we put it on the table and see it for what it is: a massive violation of our integrity as teachers and scholars, one we are being asked to accept, simply because our society is collectively unable to restrain the sociopaths.

Cioran
Cioran
11 months ago

I highly doubt that upper-level classes are dominated by students who don’t want to use AI as a substitute for thinking and learning. Maybe this is true at some top universities, but for most of us it’s not, based on what I hear from my colleagues and my own experience.

The coin dropped for me when the best student in one of my classes last year openly acknowledged that he doesn’t see any problem with letting AI do the writing for him. I’m now using only in-class assignments even in upper-level classes, and while this is far from a perfect solution, I feel that I’m doing the best I can for my students’ learning and for my own sanity and integrity as a teacher.

I also give upper-level students the option to write ungraded longer essays at home if they want to practice and develop the skills for which short-form writing in class is not fully suitable. I tell them that I will work with them closely on these papers, and that this is the best way to get a great letter of recommendation from me in the future. So far nobody has taken me up on the offer.

Big State School Prof
Big State School Prof
Reply to  Cioran
11 months ago

Just an anecdote, but the percentage of students who cheated on their essays with AI was significantly higher in my last upper-division course than in my last intro course.

Junior Faculty
Junior Faculty
11 months ago

Is it ethical to run experiments on your students without using appropriate research protocols and protections for human subjects? I understand that experiments in the classroom are often exempt from IRB control, as a matter of policy, but that doesn’t mean it’s morally permissible to run any experiments you want. While I’m not opposed to research into effective pedagogy, it seems to me that massive changes to how classes are taught should be done with significant care. Learning new ways to teach is great, assuming they are effective. But it’s not clear that we should just roll them out everywhere before we have any idea of what there effect will be. The kinds of small innovations people try with new assignment types and the like seem quite reasonable, based as they are on our previous training, knowledge, and the social science we have. But AI use is quite significantly different from previous pedagogical strategies.

Kumar accepts that eventually we should want hard evidence from social science. But what is the argument for the claim that “Until then, we should think carefully and adopt whatever policies strike us as effective—even if radically different from mine—and report our experiences afterward.” Why think this is permissible, when we don’t know what the effects will be on our students? The hard evidence we have from social science regarding the effects of students use of generative AI is not particularly promising. Gen AI is a new tool, not addressed by our previous experience or the experiences of the educators we apprenticed with.

How can we be confident that we are not significantly harming our current students education for our own benefit, or the benefits of future students? I suspect that we can’t be, and that this gives us good reason to approach these kinds of AI projects with a great deal of caution and skepticism.

Daniel Greco
Daniel Greco
Reply to  Junior Faculty
11 months ago

Everyone is experimenting right now. It’s very hard to predict what the effects of keeping traditional assignments in an era of mass AI availability will be. So while I agree there’s an important sense in which Victor is experimenting on his students, it’s a sense in which I don’t think anyone can avoid experimenting until the dust is a lot more settled than it currently is.

Does that mean I think everyone should have to get their assignments approved by IRB? No, but that’s for lots of reasons that have more to do with IRBs than with AI.

Vilhelm
Vilhelm
Reply to  Junior Faculty
10 months ago

I think the problem with this line of reasoning is that the ground has changed under academia’s feet. It’s not a case of replacing pre-AI classrooms with this new technology – that would indeed be ethically questionable. Rather, whatever you do – even sticking your head in the sand and pretending it’s still 2019 – would be a response to AI, and no response has the solid scientific backing one might want. I don’t think this response is any more ethically compromised than the alternatives.

Josh May
11 months ago

Great idea to tailor the role of AI and assignments to the level of students. A similar approach can be adopted for quizzes, which students can easily cheat on now with AI if the quiz is online. In the past, I did have mine online so they’d be graded automatically and didn’t take up class time. This term, however, I’m shaking it up.

For intro students, who have two in-class AI-proof exams, the quizzes are worth very little and students can retake them. The point is really to incentivize practicing for the exams.

For upper-level courses which lack exams, I’m making the quizzes worth more and going back to doing them in class to make them AI-proof. Since those classes are smaller, it won’t take much time to score them or administer them in class.

Joshua Blanchard
11 months ago

I think these strategies have a chance of improving things at the very least, as you say, at the margins. I’m curious whether you (or anyone else reading this comment) think there are strategies that have the faintest hope of helping in a fully online class (either synchronous or asynchronous, but especially asynchronous), where in-person essays and exams are not an option.

One thing I am planning to try this semester in fully online courses is making my long-form lecture content (where the details are not included on slides) into the primary basis of essay prompts, so that at the very least a student would have to competently relay the content to an LLM for assistance. With an additional requirement to incorporate other course material into the essay as well, it would theoretically be at least fairly difficult to have an LLM write the essay without some obvious confusion or other mistakes. Still, an ambitious and tech competent student could use speech to text software and submit the lectures to an LLM as well – so, just like your strategy, it’s best thought of as only helping in some cases. Presumably one could purposely mislead voice to text transcripts by utilizing visuals in clever ways along the way, but at a certain point this is just an obscene amount of work and innovation for instructors all driven by the threat of cheaters. I’m also sympathetic to the other extreme: people who say, “It’s my job to provide the opportunity for a good philosophical education, it’s the student’s decision whether or not to benefit from it.”

Kenny Easwaran
Reply to  Joshua Blanchard
11 months ago

For fully online classes that are meant to help students develop traditional writing skills, or learn some substantive content, I unfortunately don’t see a good way to do this right now. (Ironically, the last thing that was supposed to disrupt in-person university education, the massive online class, now seems to have been completely disrupted by the current thing, which is generative AI, much more thoroughly than in-person university education.)

Ironically, I’ve been teaching an online class several times this past year… on AI literacy. It’s only half the units of a normal class, so I’m not worried about developing traditional writing skills. I’m trying to set assignments that will give some students an opportunity to try doing new and interesting things with AI tools, even as others just do the bare minimum, and relying on the fact that they look at each other’s work to inspire them to try to do something interesting.

Good luck!

Mark Alfano
11 months ago

For those interested in the approach to upper-level teaching that Kumar recommends, have a look at our recent paper, which provides empirical evidence that it works: https://link.springer.com/article/10.1007/s44204-025-00247-1

Environmentalist
Environmentalist
10 months ago

This is interesting, Victor. Thank you for sharing he is strategies and explaining them. I have to admit I am a little puzzled about why more philosophers are not focused on the environmental impacts of training and energy consumption in data centers for gen AI. I am teaching upper level environmental ethics, and so at least for my class, I want students focused on discussing whether we should use AI before we can measure well its carbon footprint. In my mind this issue is far upstream of cognitive impacts on individuals.

https://mit-genai.pubpub.org/pub/8ulgrckc/release/2

JTD
JTD
Reply to  Environmentalist
10 months ago

Maybe because the environmental footprint stuff is badly overhyped – https://andymasley.substack.com/p/computing-is-efficient

Environmentalist
Environmentalist
Reply to  JTD
10 months ago

From what I’ve read in scientific journals there is not a standard way to quantify footprint for the data facilities, and there is also the problem that many of the companies like Open AI make it difficult to get the information that would be needed to measure the footprint. Anyone else have (non EA-DC dude substack) evidence that it is not an environmental problem?

Dustin Locke
Dustin Locke
Reply to  JTD
10 months ago

JTD, it’s wild to me how people really just don’t care about analyses like this. It’s all about the vibes.

Environmentalist
Environmentalist
Reply to  Dustin Locke
10 months ago

It doesn’t make you a little suspicious that Trump’s “AI Action Plan” says that “America’s environmental permitting system and other regulations make it almost
impossible to build this infrastructure in the United States with the speed that is required” or that all of Hannah Ritchie’s numbers come from the companies that stand to benefit from AI use (which she admits is a problem)? If there is no environmental impact, then why would the meager environmental policies of the United States stand in the way of infrastructure needed for AI?

Dustin Locke
Dustin Locke
Reply to  Environmentalist
10 months ago

Honest question: who has said there is no environment impact? Someone in this thread?

Dustin Locke
Dustin Locke
10 months ago

For what it’s worth, I don’t think “student I can trust to engage with ideas for their own sake, motivated by the pleasure of thinking” implies “student I can trust to not use AI (that is, to not use AI in a way that undermines the pedagogical value of writing essays)”. For one, I think a lot of students just don’t know which uses of AI undermine their learning experiences*; for another, even the most intrinsically motivated students have competing commitments/desires.

(*And trying to explain it to them, in a way they will understand, believe, and internalize, isn’t really going to work.)

Daniel Groll
Daniel Groll
Reply to  Dustin Locke
10 months ago

And trying to explain it to them, in a way they will understand, believe, and internalize, isn’t really going to work”

I worry about this, but want to give my students my main rationale for my no-AI policy. Here’s what I’ve written up for my incoming freshman class. A lot more could be said, of course, but I’m trying to keep it relatively simple. I’m hoping some of it kind of seeps into some of their minds. But I’m also doing in-class writing and using Google Docs etc etc because I think you’re exactly right about this: “even the most intrinsically motivated students have competing commitments/desires.”

Patrick Lin
Reply to  Daniel Groll
10 months ago

I like this a lot, Daniel.

And if “trying to explain it to them, in a way they will understand, believe, and internalize, isn’t really going to work”, then what is the value of teachers in the first place?

At least I’m going to give it a shot, just as I’m asking my students to give their education an honest shot without AI. Here’s my (longform) rationale:

https://emergingethics.substack.com/p/why-were-not-using-ai-in-this-course

I may try to distill this down into a much shorter FAQ-style document (like yours) at some point when I have the time…

Dustin Locke
Dustin Locke
Reply to  Patrick Lin
10 months ago

what is the value of teachers in the first place?”

Helping students learn how to do things, in part so that they can then appreciate the value of doing those things.

Patrick Lin
Reply to  Dustin Locke
10 months ago

Right, but are teachers also able to persuade or convince students that something is true or reasonable, e.g., that the Earth is not flat?

If they are, why can’t that work here. Or are you suggesting that students may be in the grips of AI temptation so much that they’ll be immune to reason, persuasion, etc.?

If so, ok, maybe that’s plausible, but that seems to be an empirical claim, and I haven’t heard anyone defend that before. If you have, I’d be curious to know how that defense goes.

I’d be happy to agree that some students cannot be saved no matter what, at least without heroic efforts. They’re going to cheat with or without AI. But we’d need to test whether there’s a new set of students who will cheat with AI only because AI cheating is so easy and tempting.

Dustin Locke
Dustin Locke
Reply to  Patrick Lin
10 months ago

I think that learning to write essays is a transformative experience (in LA Paul’s sense), and hence that one cannot understand (on more than a very superficial level) the value of being able to write essays until one is able to do it.

Simon Goldstein
Simon Goldstein
10 months ago

Another tool is to have students do their at home writing in a google doc which the teacher co-owns. That way, the teacher can see the total edit history of the document, to see if students copied and pasted the paper

Alex G
Alex G
Reply to  Simon Goldstein
10 months ago

Not bad, but why not just generate the text in one window and then copy it by typing it out in the Google doc? It’s a chore and you’d be bound to learn a little in the process, but a lot less work than thinking and researching.

Nate Sheff
Nate Sheff
10 months ago

The students you can trust to engage with ideas for their own sake, motivated by the pleasure of thinking?

I think it’s naive to assume any of our classes are like this anymore. I’m very sorry to say that, but I think it’s true. The incentives that motivate the so-called opportunist students are still present in an upper level course where we would hope to find mostly “enthusiasts” motivated by the pursuit of learning for its own sake. I think we can still assume that students who major or minor in philosophy, and as a result, end up in our upper-level courses, enjoy the material in some sense. That doesn’t automatically translate to knuckling down with coursework outside the classroom.