You are most likely using a charging source that doesn't deliver enough power to charge your device. While all chargers deliver ~5 volts, they differ in Amperage. Some phones will charge with the 500mA from your standard PC USB port, others require at least 2.1Amps or they will charge slowly or not at all.
What phone are you trying to charge?