Early XJs have a hex-head bolt holding the adapter in (read - easier to remove and replace the adapter itself) You could also remove the centering hole itself on the adapter (the part the oil filter threads onto). I never tried it but I'm assuming it could work. When I bought a newer style adapter to flip mine, I took the old one apart and it threads out easily.
I think it would be a lot easier than removing the whole adapter and possibly introducing a new leak if you don't seat the o-rings properly.
Also, now's a good time to read about rotating the adapter (buy a new one or flip your original, I forget where the write-up was. Maybe madxj?)
You can then fit a Mobil 1 M301 or equivalent filter that allows you to hold an extra 1/2 quart of oil. Probably not much of a realistic gain but I like the piece of mind.