In general, it seems like the Samsung AMOLED panels in the Pixel 2 may be at least a bit more consistent than the LG panels in the Pixel 2 XLs.
That said, what are you planning on doing with VR? How often do you intend to use it? Most people I know who picked up a Daydream View have only really used it a few times. VR is a great way to rapidly drain a mobile phone's battery, generating a lot of heat in the process. I don't think that it's realistically to the point that you should purchase a phone specifically for VR unless you have a very particular use case in mind.
So my recommendation would honestly be to go with whichever device's form factor you would prefer, regardless of which might offer the "ideal" Daydream View experience. If you want a larger device with minimal bezels, grab the 2 XL. If you want a device that's easier to use one-handed, get the 2. They're both great devices, and either should work just fine for casually experimenting with VR (which is really all that you can do with the technology at this point anyway).