Using AI Text Levelling Tools

a differentiation solution?

Condensing text has always struck me as one of gen-AI’s genuine strengths—especially with passages only a page or two long. Because colleagues and I constantly wrestle with teaching complex ideas to readers at wildly different levels, I decided to run a little experiment.

I grabbed a section from an open Canadian-history textbook on Winnipeg’s water supply and its century-long impact on Shoal Lake First Nation. (Copyright dodged!) Then I sent the same passage through two “grade-five level” text-levelling tools. After the fun I had last week coding responses (sadly I am not being sarcastic) I did a bit of the same here. The results were fascinating. My hunch is that these tools perform better in tightly structured subjects like science or math, but I wanted to see how they’d handle a topic that matters deeply in Winnipeg and which structures of power and colonial legacy have significant impact.

In a perfect world you’d use an AI system that lets you spell out the key concepts that must survive the rewrite, but that raises the stakes for prompt quality. For this assignment I stuck with true paste-and-go tools—the kind that lure in brand-new or still-skeptical AI users.

I’ve bundled my heuristic, the side-by-side outputs, and a brief analysis in a Genially presentation (link below). Make sure to use the show interactive elements button in the top right corner, so that you don’t miss any interactive content. I’d love to hear your thoughts.

What do LLMs tell me to worry about?

And what can I figure out from what it doesn’t say?

I went a bit overboard.

I started looking at two LLMs and then I just kept on adding one more to the list and then I ended up with a 20+ minute video and hours worth of unused footage and a look at how Meta AI, ChatGPT (v. o3), Deepseek, and Copilot handle the same question.

Fun Fact: I used the AI features in CapCut for the emoji captions!

Regardless of my overkill, it was fun. I’ve attached a couple of extra things aside from the video itself.

  1. A link so that you can check out my original prompts, and the codes that I gave to them for my analysis
  2. An interactive couple of graphs that I made in Canva so that you can see some of the data I pulled from my analysis. The charts are interactive, so click around a bit -the labels in the white menu bar under the titles allow you to see one set of information at a time.

I have to say, I’m tempted to strip the model names from the responses and my excel sheet with the records and upload it into Chat and Deepseek to see what they notice. Should I do it?

References

Coleman, B. (2021). Technology of The Surround. Catalyst: Feminism, Theory, Technoscience, 7(2), 1–21. 

Crawford, K. (2021). Atlas of AI: Power, Politics and the Planetary Costs of Artificial Intelligence. Yale University Press. 

Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. New York University Press. https://doi.org/10.18574/9781479833641

Suchman, L. (2023). The uncontroversial ‘thingness’ of AI. Big Data & Society, 10(2) https://doi.org/10.1177/20539517231206794