How come GPT can seem so brilliant one minute and so breathtakingly dumb the next?

It's not just monkeys and typewriters. It's more interesting than that.