Or more precisely: the truth or falsity of ChatGPT’s statements is incidental to the process by which it determines which statements to make.
Because unless you are using some personal definition of “tell the truth” then you must accept that ChatGPT often outputs statements which are demonstrably true.
If you accept the premise of the parent post, then this is a natural corollary.
I accept the premise of the parent post.