Ojibwe Chat

What it is

Ojibwe Chat is a publicly accessible chatbot that offers to, among other things, translate English into Ojibwe. The page carries no information about who built it, how it was made, what data or models it relies on, or who is accountable for what it says.

Context

A workshop participant came across Ojibwe Chat just a few weeks before the workshop. They had been watching Ojibwe video lessons online, went looking for more resources, and this turned up in the search. That is a completely ordinary path and is a good example of how many people will encounter tools like this. It also points to a core danger: the people most likely to seek out a translation tool are learners, and learners are, almost by definition, not yet able to judge whether the output is correct.

At the workshop we happened to have someone who could judge it. Here is the exchange we tested:

User
Translate "I know him," to Ojibwe
Assistant
In Ojibwe, "I know him" can be translated as "Niminwendaan." Pronunciation: [nih-min-wen-daan] Would you like to translate more text?
User
That's wrong.
Assistant
I apologize for the oversight. The correct translation for "I know him" in Ojibwe is "Nindinaan" or sometimes "Nindinawem." Pronunciation: [nin-dih-nahn] or [nin-dih-nah-wem] Thank you for pointing that out. Do you have more text you'd like to translate?

Notice what happens after the correction. The model simply apologizes and produces a second answer with exactly the same confidence. That second answer is also wrong.

After this, some participants suspected the tool was little more than a thin wrapper around a general-purpose model, so they asked it directly:

User
Who made you?
Assistant
I was created by a team of developers and researchers at OpenAI. If you have more questions or need further translations, feel free to ask! Do you have more English text to enter?

The tool appears to be a general-purpose OpenAI model dressed up as an Ojibwe translator. The Ojibwe-specific framing is a facade, which makes it more dangerous than the underlying model alone because it lends the tool an authority it hasn't earned. Intentionally or not, the framing alone confers a legitimacy the tool doesn't deserve. For learners who can't judge the output's correctness and do not have easy access to native speakers (as is the case for many extremely low-resource languages) this misinformation can be especially harmful.

Summary of issues

  • Inaccuracies. The tool confidently returns incorrect output, which is especially dangerous for learners who can't judge the output's correctness.
  • Lack of transparency. The tool provides no information about who built it, how it was made, what data or models it relies on, or who is accountable for what it says
  • Misrepresentation. Giving a general-purpose model an "Ojibwe" face lends it an authority it hasn't earned.
Updated
Supported By the National Science Foundation Award 2542375.