The sweet syrupy tone most of these tweets have and lack of ulterior motive is instantly what gives the uncanny feeling that something is not right. It’s like walking into a perfect suburban neighborhood where every house is perfectly maintained, lawn is perfectly manicured, every car washed, every person smiling wide as you walk down the street, gentlemen tipping their hats, a dog letting out a bark and wagging his tail, a neighbor pausing from clipping his hedges to say “Hey neighbor! Hope you’re having a good day!”
A suburbia where everything's perfect to a definitely creepy extent because the people are secretly robots? Somebody already wrote a novel about that [1] and it was made into a movie multiple times [2] [3].
> Did you know that the first Matrix was designed to be a perfect human world where none suffered, where everyone would be happy? It was a disaster. No one would accept the program.
RLHF biases the model against negativity and in favor of this vacuous saccharine HR-creature tone that is reminiscent of Linkedin. It's not an inherent property of LLMs.
But you are not having a good day.