Next door neighbour bangs on wall

My gf has a neighbour that bangs on the wall at the slightest noise, and it only happens when I come over. It's happened so many times so I try to be as quiet as possible. It's not like I am singing Karaoke out loud. Is this normal in Japan? Like he just bangs on the wall and doesn’t even come out to speak or anything. Anyways, it’s quite stressful, anyone have any experiences like this? And if so, what did u do?

by AKASHI2341