That Ctrl key muscle memory is why Colemak made the explicit decision to leave all of ZXCVB in the same place as QWERTY.
A lot of Vim is mnemonic and while relearning the muscle memory is tough, relearning the mnemonics can be useful to reinforce what you know about Vim.
(Just maybe don't make the mistake I made at one point of trying a "remap the world" configuration, learning entirely new mnemonics for classic operations, and then realizing maybe too late I'd prefer a smaller remapped config. Unlearning the wrong mnemonics is hard.)
A lot of Vim is mnemonic and while relearning the muscle memory is tough, relearning the mnemonics can be useful to reinforce what you know about Vim.
(Just maybe don't make the mistake I made at one point of trying a "remap the world" configuration, learning entirely new mnemonics for classic operations, and then realizing maybe too late I'd prefer a smaller remapped config. Unlearning the wrong mnemonics is hard.)