I have had various experiences with ChatGPT when it comes to getting it to count something. I have tried telling it to give me "8 letter words", "count number of 'r's in 'forrest', write a paragraph with 'x' many sentences, etc. Sometimes it gives me the exact correct thing I am looking for, and sometimes it is blatantly wrong, but it still acts as if it got the right answer, for example
Sure, here is an 8 letter word
<<proceeds to give 9 letter word>>
I would like to know once and for all, is ChatGPT (or text generation LLM AI's like it) capable of counting?
It seems to do simple math (like it gets 1+1 = 2 every time), but that could just be because of how its training works. I doubt it can do any kind of trigonometry or calculus operation.