I note that there has been some front end work and alignment, and wonder if in this process it got too much toe-in or if there's something still loose. If there's any play in the system, an unpowered front end will tend to toe out (hence the usual call for a bit of toe-in on rear drive cars), but a powered one will tend to toe in under power. It doesn't take much or either to mess up handling, so , though it's a bit of a long shot, I'd double check the alignment. A tape measure is a poor gauge unless you've scored the tires.
If you have a chance, get a big piece of chalk, or in a pinch, some cheap spray paint. Take a two by four or other block of wood, drive a nail partway into the end, and snip off the head. Bend the nail up a bit. Now with the steering centered, on a decently flat surface, jack up each wheel just enough to spin it, coat the tread with chalk or paint, and slide the nail-studded wood on the floor until it makes a nice clean score on the tread of the tire. The exact location does not matter, as long as it's a steady score all around the tread. Do this on both sides, and let the car down. Now if you measure from score to score, at the center height of the tire, the difference between front and rear will be the exact toe-in, no error from tire warpage or poor guessing.
The spec for the XJ is zero toe-in.