ChatGPT and Logic

Day 62 / 366

Today I was watching a YouTube video about a novel that was written without using the letter e. This is fascinating because ‘e’ is the most used letter in the alphabet. I thought how tough it would be to write a blog post without using ‘e’, and then quickly had the idea that this would be the perfect task for which ChatGPT will be able to help me.

So I went over to ChatGPT and gave it a simple task — “Write a blog post about India without using the letter E”

As you can see it failed miserably. Not only did it use words with E, but sometimes it just removed e from a word and used it, like ‘tim’ and ‘cultur’

This is really disappointing and also tells us that maybe we are overestimating how good LLM’s are right now. I agree with the general idea that training on a large amount of human text leads to emergent behavior like the ability to write code or translate languages, but until and unless it gets more accurate and logical, it will remain a gimmick.