top of page
Search

Copilot vs ChatGPT in a hallucination contest

Faruk Mardan

While the hype around LLMs (large language models) is certainly justified and understandable, we still need to poke some fun so we don’t forget that they still hallucinate.

I’ve decided to have a chat with Copilot and ChatGPT in Uyghur and see if they’ve improved since June 2024, when I had this conversation with ChatGPT.

Translation:

Me: How are you?

ChatGPT (spelling is all wrong so I had to presume this is what it meant): That place, I know? If you are a garden, we will ask until the floor scolds us.

So, this is how good ChatGPT was at Uyghur in June this year. And of course, it should come as no surprise that this is what I got when I asked ChatGPT the same question in English:

Now that we have a baseline comparison, allow me to take you on an adventure of Uyghur culinary experience with LLMs. I asked Copilot how to make Uyghur-style kebab, the answer was… well, I’ll let you decide. For your reference, Uyghur-style kebab is fairly easy, marinate mutton or lamb with salt, cumin, paprika (optional), onion (optional) and an egg (again, optional) for an hour or so, thread the meat onto skewer and start grilling!

However, Copilot thinks otherwise:

A (rough) translation (as parts of it are not even Uyghur, it’s alienese):

This legacy from the ancestors helps me survive the day with delicious food! Leave it with me to explain the cooking method of Uyghur kebab step by step:

Ingredients needed:

  • 1 kg of meat (mutton or lamb)

  • 2-3 large chunks of frozen meat

  • 2-3 spoonful of olive or plastic plant oil

  • 1 spoonful of salt

  • 1 spoonful of red pepper inflammation (wrong spelling, or it perhaps meant ‘yalla’ in Arabic?)

  • 1 spoonful of bitter herb

  • 2-3 dust covered [a word missing] (optional)

Preparation: (Me: Oh God, I’m dreading this!)

  1. prepare the meat: cut the meat in small pieces (Me: so far so good!)

  2. marinade: bash the meat, add salt, red pepper inflammation, bitter herb and olive oil. Leave to marinade for 2-3 hours on a separate road

  3. lay on the meat: lay the marinaded meat on the manners and mix with other materials.

  4. (cook?) the kebab: [jibber jabber jibber jabber] place on high heat.

Method of (continuous?) cooking:

Keep confusing the meat (until?) it’s superior, and cook on white fire for 15-20 minutes. Mix with salt and (pilgrimage?) This will enhance the taste even more.

Kebab cooked in this method will be delicious and ruin your expectations. It goes well with coffee and many fruits. Good luck. (If you have more questions, just ask me?)

Are you tempted yet? Now let’s leave the kitchen to ChefGPT!

Again, this is a rough translation:

The Uyghur-style kebab has a traditional colour, the meat is usually soft and delicious. Here are the steps of cooking Uyghur kebab (after a beating?):

Products needed:

  • [alienese] spoon [alienese] soup [alienese], in most cases mutton or [alien] meat is appropriate.

  • blue (wheat straw?) in an appropriate amount

  • salt

  • black wolf

  • white wolf (one that meets the expectation)

  • [alienese] (or blue [alinese] is also okay)

  • red pepper powder ([complete illegible alienese])

  • oil, as if it will never end? (Me: pour the oil like you just don’t care!)

Preparation and cooking:

  1. cut the meat

  2. cut the mutton or alien meat into the size of a spoon.

  3. press the meat with iron or a unique spoon in rows, and marinade the meat with equal amounts of oil and powder

  4. add taste

  5. season with (wheat straw?) or white wolf. Add salt and all sorts of sweet dessert. (No, cumin and other spices) use the right amount and mix them up.

  6. after seasoning, observe for two hours and get ready to cook

  7. place on the fire

  8. You can cook on any kind of flame or traditional [alienese] is appreciated. Cooking on the hob (is also okay?) [the rest is illegible]

  9. cooking with coal

  10. Until the meat turns red, expect the meat to turn into many colours. The meat will be red and juicy. [the rest is really untranslatable, believe me, I tried]

Well, there you have it! Tell me which recipe is calling for you? I’m off! All this kebab talk is making me hungry. If anyone knows where I can get some white and black wolves, please let me know. I need them for my kebab!


 
 
 

Comments


bottom of page