Cycling in January-February

Hi it's my first time spending January and February in Japan. Is it too cold to ride a bicycle comfortably around town?