I purchased a replacement arm rest and was able to pop off the cap and remove the holding screw but don't want to get to aggressive with trying to pry off the old arm rest without some general guidance. I am assuming there is a place to insert a screw driver and force it off?? Thank you for any help you can offer.