O2 sensor shield broke off inside.

The thin thimble sized O2 sensor cover fell off inside my pipe. How delicate is the element in the catalytic converter? Will this piece damage it? I don't want to take the pipe off since it was a mojore pain to get it back together with out leaking.

'90 XJ 4.0L