I don't see anything you linked saying this is the case for final exams? Which is what I was clearly and specifically was talking about. And any theoretical advantages are irrelevant if it means I am physically incapable of doing it and thus fail? Setting aside other issues like reading someone's handwriting.There's evidence that this is not correct. The act of writing seems to enhance learning in and of itself.
It probably won't help you feel any better, but I'll say it anyway: some of us do very much value teachers and all the time and effort you put into sharing your knowledge and skills. What you do still matters even in this age of slop, don't let the grifters and propagandists put you down! It can't be easy for you guys, but I hope you can find a way to power through.I’ve been teaching college Earth science courses as a part-time faculty member for a long time now, all while juggling other jobs. I started because it was enjoyable; no one gets into this line of work for the famously poor pay or complete lack of job security. Working with students is just one of those genuinely fulfilling experiences that is addictive enough that they ought to warn people about it.
But thanks to generative AI, it has become mostly miserable―at least in certain settings.
I don't know. There's a skill and a certain learning that goes into recognizing that Leonardo is Leonardo. There were and I'm sure are also a lot of wealthy patrons who threw their money away garbage.People using AI aren’t doing work. They’re commissioning it, just like a rich patron commissions art. Of course they learn nothing. They did nothing.
Our experience has been that the floor has been raised tremendously, but good students (or job candidates) using LLM assistance are standing out less--regressing to the mean, as long as humans are putting in the time to read submissions. Those that that stand out as unique (whether truly human-generated or just with a better prompt, who knows) get more attention, even if not technically as polished.However, if everyone else is producing heavily tool-assisted work (even if they barely understand the output), which is slick, competent and looks professional, then there’s a possibility that honest, thorough output worked through from first-principles will no longer stand out, and may even seem lacklustre by comparison.
There is a real debate over whether Charles Saatchi recognised Damien Hirst's artistic genius, or whether he used money and his skill as an ad man to essentially create the brand of Damien Hirst, artistic genius.I don't know. There's a skill and a certain learning that goes into recognizing that Leonardo is Leonardo. There were and I'm sure are also a lot of wealthy patrons who threw their money away garbage.
Errrr… just ban phones from the examination room?You obviously haven't been keeping up with exam cheating technology. We've long since passed the age of notes written on arms or legs. There are whole kits you can buy that let you connect miniature wireless cameras and speakers to your phone, so someone can see the question on your exam and dictate an answer to you (no doubt using an LLM to generate text these days). The wireless ear pieces in some of these kits are so small, you need a magnet to retrieve them from your ear canal. You can bet that those taking the Korean civil service exam (and those having to invigilate it) are very much aware of these kits.
There are smart-glasses rental services for exams, now. Because LLM-enabled smart glasses with cameras and screens are expensive, so "entrepreneurs" are buying them and renting them out by the hour for students to cheat.Errrr… just ban phones from the examination room?
Errrr… just ban phones from the examination room?
Unenforceable, especially at scale. (Do you want to be responsible for collecting and returning 1k+ cell phones per exam?). The phone doesn't have to be visible at all for the system to work, just near enough. And never mind the diabetics who use their phone to check blood glucose readings and control their insulin pump...Errrr… just ban phones from the examination room?
I'm willing to accept that there may be a day where we don't have to worry about this because dedicated teachers are no longer necessary, but I think we're still at the point where we should take seriously a factor that drives people away from a profession dedicated to preparing high quality humans in the next generation. Can't back that up with data, however.Even in this essay where "instructors hate this" is your central thesis, it's hard to connect with you emotionally since the persuasive part is all about student learning. There isn't really an explicit argument that making instructors miserable is bad. I wish you had told us more clearly that we should care about teachers being miserable.
This is a really difficult issue to solve, because when policies are put in place to address the genuine needs of disadvantaged students, those policies are often actually exploited by students who are most advantaged.Secure testing can be (and has been) attacked as "inequitable". It is "unfair" to students with anxiety disorders, with ADHD, from underprivileged backgrounds, cultural minorities, etc. etc.
I used to teach an introductory Astronomy class - I would have two groups of students: the Star Trek Geeks who would sit in the front row and ask me questions about black holes and the Big Bang, and the other half sprinkled thought the room who were just there to get a required science credit.Just go back to grading fully based on supervised written exams.
Like so many other "laws" (ie, "useful aphorisms", including "move fast & break things" or "obscurity is not security") on the internet Goodhart's should be taken as a starting point for reflection and critical thinking in context. Not merely trotted out as an end in and of itself, or else it risks it risks becoming a bromide. Goodhart's law would be better written as "when a proxy measure becomes a target, it ceases to be a good measure", which both gets to the point but also helps consider that sometimes proxies are the best we've got. Sometimes one just needs to measure better.Goodhart's law: When a measure becomes a target, it ceases to be a good measure.
Have we? Or have we allowed grades to get diluted due to perverse incentives? Is the appropriate response to surrender on that or to attempt to realign via better tests? It's pretty important to figure out what the foundational demand is or else we'll just end up reinventing the wheel with new labels. Like with grades, yes the true goal is a complex combination of "how can we motivate students to learn, and measure how well they're learning in a dynamically granular manner, and also measure how well they handle meta tasks related to learning that matter for real world unsupervised activities including continued learning and learning application, and then also convey all that in a high density form that decision makers in different domains can make use of before the student in question has more track record, and also we need to feed that back into how we ourselves are doing with our teaching/methods". That's not an easy problem space, but it's key to recognize that grades became and have continued to be a thing because they've been useful.We have culturally allowed grades to take on very outsized importance in people's lives and that has completely undermined their usefulness for learning.
But students very much actively want to be able to convey their achievements outside of the class. The whole point for most students is linked to the real world, to getting good jobs or other opportunities they desire. "Consequences" are therefore fundamental, touching on various zero-sum games. Of course people are going to care, and some people are going to do better relative to others, and the ones who do worse are going to have incentives to cheat. You can't just side step all that. Like if some colleges stop providing grades as you suggest, game theory out a bit the results of that. Students exit college, and go to apply to some job, and naturally the company wants to know how they did. How do they convey this in a rapid objective fashion? Will companies then preferentially recruit from colleges that do still provide grades? What would the result when it comes to where future students apply to, and the consequences for the colleges without grades they don't? Etc.As far as I can see, getting back on track is going to require a cultural shift toward grades being a within-class metric of learning only, giving teachers substantially more power in their classrooms to make decisions without fear of challenges and consequences from students, parents, and administrators whose motives have little to no connection to learning.
Oil prices are going up and never coming back down, I suspect we will all get our wish sooner rather than later when paying for the electricity to waste on token generation forces all the dozen or so big gen-AI players to paywall everything and model evolutions behind pricey tiered subscriptions.You have my sympathies.
The embrace of LLMs is just so insanely stupid. I long for the day when the current bubble business model collapses. I’m sure there will be LLMs after that, but they’ll need to be priced beyond casual users.
Fingers crossed. I may be Pollyanna.
Disagree with that - the CEOs want us to think we can depend on them but really its a world where people don't realize they're getting smothered in wrong (and often dangerous) answers.We are sleepwalking into a world where people are so reliant on LLMs that society cannot function without them. The CEOs of these company know this - in fact, they are counting on it to allow them to raise the rates of LLM product subscriptions for professionals exponentially. Access for students will continue to be low-cost or subsidized by the schools, of course.
I appreciate this take on perceptions, but want to add that there are many schools outside the big ones that prioritize student affordability and quality teaching. I've seen the budgets, and there is no profit. Money goes to student support, facilities and paying faculty [edit: and staff] less than they could make in industry. It truly makes me sad that this message doesn't get out more.Education has value, but apparently students aren't seeing it.
And why is that? Because universities have made it clear that they are profit seeking entities designed to squeeze every last cent out of students and their families while education is treated as an accidental side-effect of the process. The widespread belief in grade inflation means that anything less than an 'A' is a failure. And when they finally do end up with a job (probably not in their field), they'll be told by a cynical middle-manager that almost nothing they learned in university has any relevance to the work they're supposed to do.
There's a perception out there that university is largely a scam*. If that's really what you believe, why wouldn't you cheat?
*I got my degree sometime during the late Iron Age and students (and hiring managers) were already pretty cynical. Still, to me, cheating seemed an obviously self-defeating short-cut. But then I wasn't looking at a permanent lifelong 6-figure debt either.
1) Students are really bad at determining what is irrelevant for them in the future. Something that seems unrelated now becomes the edge that lands you the better job laterKeep on mind that the US University system makes student take classes and get good grades in subjects that are entirely unrelated to their Major.
While it is good for University to get 4 years of tuition for what should be a 3 year degree, I don't blame students for finding short cuts to get good grades in irrelevant courses.
The real underlying problem is actually a completely different one. Namely, that students focus on obtaining a degree at all, instead of simply wanting to learn something out of genuine self-interest. Degrees are job-prevention systems. They say very little about whether a person would be well suited to perform a specific job — but at the same time they act as a filter that prevents people from even being considered for it.
The education system in many countries is a learning-prevention system, in that it shifts the joy of learning toward the obligation to obtain a degree. I don’t understand why people don’t finally start addressing these root problems, especially now that large language models are making it so obvious that the previous cat-and-mouse game benefits no one.
An alternate view - LLMs isolate students when working outside of class, as they obviate the need to study/collaborate with other students. Students learning from each other is important and instills the value of collaboration - which they will use hopefully both professionally and civically.I write as if they consider that to be a valuable use of their time. Sure, I think they're wrong, and I don't think it's a judgement most of them are making consciously, but I do think they're making it.
Humans are a social species. Most folks come with a set of basic instincts that tells them to value social connection, and a basic upbringing that tells them to value at least their own group. "Goofing off with friends" is building social connections in the community. Scrolling Tiktok isn't, but it feels like it is when you're doing it.
So, respectfully to your point, yes, I do think they're choosing between a busy schedule of activities that, to them personally, do seem fundamentally worthy.