Perhaps the battery in the FOB is near-dead and the time-effect is temperature related. Slide off the silver cover, and pry the two halves apart using the key blade to get inside.
When you change it, I'd also clean the gold contacts with a pencil eraser to make sure there's no gunk preventing...