You may have vacuum to the axle, but if the diaphragm is shot, it just leaks air without moving the shift fork - which is IMO the #1 reason most systems fail - engine oil contamination that deteriorates the rubber.
Once you unbolt the shift fork assembly, you can check it's operation, the integrity of the fork, and then decide if you'd like to just block it in the 4WD position (like late models - no shifter at all) - or change over to a mechanical cable. Then you can dump about 15 pounds of junk tubing and stuff that gets torn off wheeling anyway.