I have the same problem. Most of the time the signal is one or two bars. I stood a foot away from the router and it never went to full strength. I have two wireless routers. The Droid has the same problem on both. I reboot the Droid and it was a little better, I finally got a "Full" strength a foot away, but as I walked away it's dropped immediately.
Does anybody know if there is a firmware update or something available to fix this issue?