Live in Japan and living off husbands income from the US

My kids (ages 3 and 4) and I are planning to move to Japan from the United States next March. I am a Japanese citizen and my kids have dual citizenship.

My husband who is an American citizen will continue to work in the U.S. next year but will visit us every couple months, and eventually in 2027 or 2028 will come live with us on a spouse visa.

My question- My husband and I have a joint bank account in the U.S., and I plan on transferring money from the joint bank account to my Japanese bank account for everyday living expenses in Japan after we move. I will be using Wise to make international transfers. It will be $3000 – $4000 every month that I will be transfering to my Mitsui Sumitomo bank account.
Do I pay taxes in Japan for this?

Additional info-
I currently have a US green card but unsure whether I will renounce it next year
My husband owns a company and his annual salary (including profits) is $300K.
We file US taxes jointly
I am currently not working and plan to not work in Japan for the next couple years while my kids are still small.

by Comfortable-Trade-90