as Rhino_66 said you have not saved much by not pulling it out, HOWEVER their certainly is no real damage I could see by leaving it in a bit. Make certain you get all the chips out before you press back in. Also I personaly would spray in some lube before you press the barrel back in. If you want to do it this way I say DO IT then post back here and let evryone know how it went.
Another word of advise is to check for galling when the barrel pushed out, if you see galling then you may realy want to get it all the way out to sand off the high spots.
TRY IT and good luck,, BTW what barrel do you have?