ADM has a few different functions: locate your phone; ring your phone, wipe and lock.
I think location access is required if you want Android Device Manager function to locate your phone, but only internet access is required for the wipe and lock function that the op asked about. (it's wouldn't seem logical to require location access for the wipe and lock function)