The IAC stepper motor should be giving you the correct idle, and that would be 725-750 rpm, in drive (friend sitting in driver's seat with foot on brake, parking brake on), engine fully warmed up.
The IAC may not be functioning correctly, either bad or just dirty. Do a search for IAC.
Also, there is a small allen screw (3/32" on my 90) that allows you to set a base idle for the XJ.
If yours has been adjusted in the past, perhaps by someone trying to compensate for an intake leak, then it will have to be reset.
First, remove the rubber intake hose. Good time to spray some TB cleaner around the throttle plate area. Ok, now take a look at the throttle plate. It should be almost fully closed, as the IAC should be able to give you an accurate idle, but adjusting it slightly is Ok--it should just start opening the throttle plate.
Don't forget to check/readjust the TPS.