Ever since the 4.0.4 update, I often run into the situation where I have bars, often 3 or 4, but no app can connect to data. At least, I usually test the browser or speedtest. Toggling airplane mode usually fixes it.
I think it happened on 4.0.2 from time to time, but maybe I didn't notice it...