How do Japanese people recognize the difference between Japanese, Chinese, and Korean?

I’m Chinese. Recently I travelled to Japan twice: one time with my girl friend and one time with my parents. When we went to shops and restaurants, Japanese staffs there spoke English and showed translated information paper to us even before we started any conversations. Does anyone have similar experience? How did they tell the difference?