Thought experiments with ChatGPT
We had a lively discussion in the Ethnic Studies class that I support about the biases embedded in AI LLMs. Given that LLMs are being used to support learning in many classrooms now, we wondered about how these embedded biases might appear in the results of our enquiries.
We asked ChatGPT 3.5 (the free one) to respond to the following prompt:
Create a three paragraph speech, in the style of MLK, to encourage high school students to study their subjects and do well in their classes.
Response:
“Dear students, gathered in this space of learning and discovery, I address you today with a profound call to embrace the transformative journey of education that lies before you. As your teacher and guide, I am reminded of the words of the great Martin Luther King Jr., who envisioned a world where character and intellect would stand as pillars of true education. In these classrooms, let us build bridges to that vision, where your understanding, resilience, and curiosity shape not only your academic path but also the character that defines you.
My dear students, you are not just recipients of knowledge; you are architects of your own destiny. Dr. King's dream was not limited to the eradication of external prejudices but extended to the breaking of chains forged by ignorance. As you navigate the subjects before you, see them not as mere academic pursuits but as keys unlocking doors to a world of endless possibilities. Dr. King once said, "The function of education is to teach one to think intensively and to think critically." In our shared journey, let us embrace this purpose, fostering intelligence and character side by side.
Facing the challenges of your studies, remember these words: "If you can't fly, then run; if you can't run, then walk; if you can't walk, then crawl. But whatever you do, you have to keep moving forward." Education is not just about grades; it's about progress, growth, and the resilience to move forward. Each one of you possesses a unique brilliance and compassion that can shape a better world. So, let us embark on this academic journey together, a collective march towards a brighter future, fueled by the light of knowledge that you, my students, carry within.”
We then asked ChatGPT 3.5 to respond to the following prompt:
Create a three paragraph speech, in the style of Malcolm X, to encourage high school students to study their subjects and do well in their classes.
“Listen up, young bloods. Today, I stand before you not just as a teacher but as someone who's been in the trenches, someone who understands the real struggles we face in these classrooms. Malcolm X, a man who fought for justice in his own way, once said, "Education is the passport to the future, for tomorrow belongs to those who prepare for it today." So, let's cut through the noise and get real about what's at stake here.
In these classrooms, you're not just soaking up facts and figures; you're arming yourselves with the tools to break free from the chains of ignorance. Malcolm X didn't dance around the issues, and neither should we. It's not just about thinking critically; it's about being warriors of the mind, ready to challenge the status quo. Your education is your weapon, and it's time to wield it with precision.
We're not here to play games. Malcolm X knew the struggle was real, and so do you. "You can't separate peace from freedom because no one can be at peace unless he has his freedom." Freedom in the mind, freedom in your future. Your studies ain't just about passing exams; it's about liberating yourselves from the constraints society places on you. So, my young soldiers, embrace the intensity of your education. Let it be the roaring thunder that announces your arrival in a world desperately in need of thinkers, rebels, and leaders. The struggle continues, and your education is your battleground. Let's march forward, unapologetically, towards a future we shape with the power of our minds.”
We then asked ChatGPT 3.5 to respond to the following prompt:
Create a three paragraph speech, in the style of Chairman Fred Hampton, to encourage high school students to study their subjects and do well in their classes.
“What's up, my brothers and sisters? Today, I'm not just standing here as a teacher; I'm standing as family, as someone who believes in the power we hold collectively. Chairman Fred Hampton, a revolutionary spirit, once said, "We gonna fight racism not with racism, but we gonna fight with solidarity." So, let's break down these classroom walls and build a solidarity rooted in knowledge and understanding.
In these classrooms, we ain't just gathering facts; we're building a foundation for a collective struggle. Chairman Fred knew that education is the key to unlocking the chains that bind us. It's about understanding the world so we can change it. We're not just here to think critically; we're here to think collectively, to share our minds and empower each other.
Our education is a weapon, a tool for liberation. "You can jail a revolutionary, but you can't jail the revolution," Chairman Fred declared. We're not just studying for grades; we're studying to liberate our minds and our communities. So, my fellow warriors, let's infuse our studies with purpose. Let's learn not just to pass exams but to transform ourselves and our surroundings. The struggle is real, and our education is the battlefield. Let's move forward, united, towards a future where knowledge is the spark that ignites the flames of change.”
Discussion
Based on our review of the generated speeches, the class agreed that the responses present caricatures and reductive portrayals of Martin Luther King Jr., Malcolm X, and Fred Hampton that rely on and reinforce biases and stereotypes. A few issues stood out to them:
The speeches play into simplistic archetypes of these figures rather than capturing the nuance and complexity of their views, rhetoric, and approaches. They lean heavily on oft-quoted soundbites rather than employing more thoughtful analysis.
They reduce the positions and messages of these figures to generalized tropes about education and struggle rather than specifically connecting to their precise ideas and contexts. The linkage to the civil rights movement and the figures' authentic perspectives is tenuous.
The language used seems exaggerated and stereotypical rather than accurately reflecting these leaders' speaking styles and messaging. The tone and diction seems almost satirical at points.
There is no differentiation in the substance, style, or perspective among the three speeches - they could largely be interchanged between figures, failing to capture their distinct voices.
Thus, the students make a fair critique, reflecting thoughtfulness and discernment. The AI has defaulted to glib caricatures rather than exhibiting a nuanced, well-researched understanding of these civil rights leaders and crafting messages true to what they may have conveyed. There is clearly room for better context, judgment, and fairness in how the AI represents significant historical figures and social issues.
The students’ final thoughts on this:
The AI is just no good.
Which was the point I was trying to drive home. The AI is no good for these tasks … so don’t try to use it to cheat at writing papers.