Welcome to Android Forums!
if you mean the "my Verizon" app, it's probably set to auto update. If you launch the market from the phone and find the app listed, you should be able to un-check allow automatic updates.
To completely remove the app, you have to root your phone.