That's correct, but it's not a contradiction to say "the final penultimate" thing for the reason that it's not a contradiction to say "the final last" thing. Just redundant.

Though the sibling has a point that there may actually be multiple penultimate things if there isn't a strict ordering between them.