Anecdotal polling from my peer group strongly suggests you are wrong. Every guy I know would rather be responsible for taking an equivalent pill than the woman taking it. Every single one of us has experienced one or more women who missed taking the pill a day here or there and those women weren't that concerned about it. As an add-on (depending on jurisdiction), women have the backup of the abortion decision whereas men do not.

You don't think men worry about having a kid with someone they don't want to, being responsible for 18 years of child support, making hard decisions about whether they want to be involved in the kid's life, etc.?

Men are terrified of getting someone pregnant. At least women have a choice as to what to do about it. If they don't want to keep it, they don't, assuming the law permits it or the law is easy to get around. Men don't ever have that choice.