If you go into the market, hit the menu button and go to "downloads". From there, you can select the individual apps you have installed. When you select one, you'll see at the top of the window a check box for "Allow Automatic Updating".
You have to enable/allow this for every individual app.