Driver's side inside door trim.  I am trying to replace the outside side mirror and it looks like I can't get to the bottom two bolts unless I remove the whole door panel. 98 Legacy Sedan 
  
Does the whole panel there just pop off?? I started pulling on it and the front part popped off and on pretty easily.  Before I went ahead and pulled the whole thing off I wanted to check here and make sure I don't break something. 
  
please advise any tips, etc.  
  
Thanks in advance!