I was wondering if I can pop off the driver's side armrest (the part where the window switches are) without disassembling the door, just by prying it off, and if that would do any damage. It's peeling really bad and I want to replace it. Thanks!

 

its so simple to just take off the door panel its 5 screws and then u lift up and pull towards you and its off, then you can correctly remover the armrest and replace the vinyl

 

I agree. It might be possible to do what you're asking, but i feel like at some point during the process something will break and you'll be pissed. Taking the door panels off is easy enough that you should just do it right the first time