Discussion about this post

User's avatar
Paul Snyder's avatar

Ok… I’m left a bit confused regarding your recommendations.

I’m familiar with this specific Brown “scandal”. I have a former associate who currently instructs there who has no direct contact with this situation, but has conversed with me regarding more “Big Picture” analysis regarding knowledge, practical evaluations, ethical considerations, etc.

I’ve instructed some specialized technical courses at major universities. I do not come out of any university system, but from the Naval Nuclear Power Program. I only note that to admit my “outsider” viewpoint regarding traditional university educational paths and evaluation methodologies.

My own kid is, coincidentally, currently wrapping up her Master’s right now, so I’m not entirely unfamiliar with recent changes in the higher education system.

I’ve heard many snappy self-righteous assessments regarding the character of the students involved in this matter. My younger self (pre-60) might have quickly grabbed the low-hanging fruit of righteous indignation that these students did not knuckle down and engage their exam in a similar manner to that we employed in the late 1970s / early 1980s. Hours of rote memorization, recopying of binders of notes , etc.

As I’ve gotten older and watched my daughter and her fellow student negotiate increasingly absurd educational infrastructures, I no longer leap to judgement of the individual students but attempt to determine how the system has failed.

My first M-Div Chief on our boat had a good analogy… If you’re hammering away and it’s getting you nowhere in your task, you can either seek out a bigger hammer or consider whether you might need an entirely different tool for the job.

Statistically, it is unlikely that the proportion of students who used AI for some or all of that exam suddenly degenerated into amoral schiesters. Given the accomplishments required to even be admitted to Brown (though I understand that there are paths to elite universities that bypass intellectual rigor) it is unlikely that any of those students could be simply dismissed as lazy or a craven opportunist.

I could go on about this, though I’ll just attach the El video discussing this topic. I found her points to resonate with my own. She looks much better and has that intriguing accent.

I do agree with what I feel you’re saying in that “we” as a culture are almost entirely unprepared for the cultural effects of AI. I do not at all feel the technology is approaching (or will approach in any near future scenario) the level of societal impact implied by vapid hucksters such as Amodei and Altman, but our collective systems only barely grasp where we were in the information infrastructure realm PRIOR to LLMs becoming commonplace. Now that everyone’s got their own little Chatbot influencer we need a broad public education program to assist in defining where we are, and more importantly ARE NOT. China seems to have a much better cultural grasp on those two benchmarks than do we here in FreedumLandia at present.

Thanks for your efforts. All the best.

https://youtu.be/Hw8twdIjMJc?is=sYDqrl4clv_IOauF

PAUL Anne's avatar

Thanks: again, and as usual, delightful food for thought!

As a matter of fact, we have been brainstorming on the question of teaching and grading students in the time of AI and what strategies could prove useful.

Here, are some conclusions that may (?) tackle the problem in a different light (? again, many question marks)

­ - Teachers will have to adjust (evidently!) but are not doomed in an AI-society, even though, many institutions want to replace us by “teaching AI”

­ - Two phases of activity should be distinguished: (1) the process (all the activities and their organization involved in discovering / learning / doing something, “something” being defined by a goal) = “the how to” and (2) the product (more precisely the evaluation of the end result, its adequation to the goal) = “the honestly relevant?”.

­ NB evidently those two activities should be performed in alternance to verify that the process is still aligned with the goal and that the product is still useful and suited to the goal (and hopefully, as best as possible).

­ - Teachers should help student to develop proficiency in both, with careful delineation of these two activities and can make use of AI (or not) – and there, the human interaction, with all the unvoiced information, the subtext, the silent communication cannot (yet?) be replaced by AI.

­ - Grading should not aim at evaluating either the process or the end product since there a many ways to reach a desirable goal, each suited to the person doing the work and what he as to work with. We propose that grading should aim to evaluate how the student is able to justify why this product fulfill the goal, how it is simultaneously suited to the need, the context, the actors, the constraints … ie being capable of situating the product in the (real) world, with (real) actors… Again, the use of AI is neither forbidden nor mandatory but is simply not taken into account: it is up to the student to decide whether AI can help him (or not). This grading strategy can be applied to anything, from fulfilling a MCQ, to writing an essay, to design or do a task or grasp what something means.

We are conscious that this strategy is much more demanding upon the students (and the teacher) and that some won’t reach this level of proficiency. However, we but hope that every student will still gain from this type of teaching / grading strategy. We also think that it helps to develop both critical thinking and (reflexive) uses of AI. Furthermore, we are not only aiming at adapting teaching to the fact that in many professions, AI-proficiency will become a necessity. We are thinking of helping youth adjust to a world where all sorts of AIs are silently creeping in each and every aspect of our lives.

Again, thanks a lot for your wonderful blog.

Anne

9 more comments...

No posts

Ready for more?