I suspect some issue with a worn out key. You can order just the key part from the dealer, and a cheap replacement FOB housing, and a battery on amazon and assemble it all..
I suspect I'm getting to a similar point, where once in a while I can't get the key out, so either the actual column lock is shot or the key, I suspect the lock itself.