Japanese language school with N2 level Japanese?

So, I used to live in Japan for 2 years (study & WHV) and I really want to go back. The lifestyle there suits me perfectly and I can speak N2-level Japanese (I have a Bachelor's in Japanese too and am a native English speaker).

I've been looking for jobs in Japan online, but I've really struggled to find anything that accepts overseas candidates, especially since I'm not interested in IT/business/recruitment, and especially not being an ALT. For reference, right now I work as a freelance translator and want to continue this career (or something in a creative field), but all job offerings I've seen for it require you to already be living in Japan even if they offer visa support.

So now I'm considering attending a Japanese language school for 3-6 months and using their career service to hopefully land myself a working visa in a field I'm actually interested in. But I don't know if I'd even be accepted if I already have advanced Japanese skills? If possible, I'd like to study an advanced/business Japanese course right away, without wasting my money on N5 level classes.

Does anyone know if that's possible/been done before? Or maybe you have other advice on what I should do? As a side note, I cannot afford a Master's in a Japanese university, so that's a no-go.

by diminee