I experienced this at first with my ergo, and for me it is currently not an issue. There are some minor issues with some of the super common keys that are in different places (like enter which is currently on my left thumb on my ergo, and right pinkie on normal keyboard).
Starting with my ergo was also very disheartening (for me I went way too extreme with my switches which killed my accuracy for a month), but I love it now.
HolyKeebs just announced their new keyboards with integrated trackpoints: https://holykeebs.com/pages/trackpoint . Something they do that is really cool is build them into the microcontroller itself, so if your board has the microcontroller in a convenient place, you can add the trackpoint straight to an existing device (already sell it for pimoroni trackballs, trackpoint in Q3). I have a Corne from him with the pimoroni, and I enjoy it, but the pimoroni is not a full mouse replacement for me.