[For a second there, Shinji actually felt kind of bad for not being there when Panda showed up, even though there was no way he could have known he was coming. ...but then it sounds like he's trying to get rid of him, and he changes his mind about feeling bad.]

I couldn't go on vacation even if I wanted to. There's nowhere to go here. [...he doesn't know why he's telling him, he should know that already!] Besides, Pen-Pen can take care of himself. Probably better than you can.