Upon entering, can I immediately exit Japan without invalidating my visa?

I have my CoE and will be applying for my visa shortly.

I need to temporarily leave Japan almost immediately after entering, I understand I'd have to get a re-entry stamp, but I don't know if I need to have the residence card with me to go out and come back?

Do I have to register and have the card updated with my address before I can safely leave and come back without invalidating my visa?

Any help or advice would be appreciated, none of the numbers I have for enquiries are working and HR don't seem to know for sure.

Thank you.