move emergency brake back

I've put in a lift which came with longer brake lines, but not for the e-brake. My 2000 XJ's driver side e brake is almost pulled tight when the axle drops an inch or two.

I was wondering, can i just move the whole bracketry (where the single lever's cable gets divided into two cables and such) back a few inches? Has anyone tried this? It looks like there's room because the cable upto the lever has a good bend to it and could probably give a few inches. I'm not talking about adjusting the left to right, but actually moving all the brake stuff backwards.

How much lift do you have?
Bracket relocation

5.5". thanks for the link (so I should just pony up for a longer driver's side line)