When a programmer works on an app he sometimes runs it in debug mode, debuging allows you to run the app stage by stage and monitor it's state and behavior. USB debugging allows the app developer to do it on the device instead on software on his computer using an emulator for Android.
If you're not developing an app, you can disable that option.