How is the Japanese comma (、) used?

I'm learning to read and write, and along the course of this I've noticed in example sentences that the comma seems to be used slightly differently in Japanese compared to English – or rather, sentences are broken up with them a little differently. I use commas a lot in English as is, and am a little worried I might overuse them or be tempted to use them more like I might do in English.

Is there any good rule(s) of thumb for when to use a comma in Japanese? Is it something you just have to feel out over time?

by pt-pal