How to bridge the gap between learner content and native content?

I passed the N2 test this past December, but recently I've been REALLY struggling with my studies. The main issue I have is that I simply can't understand content made for native Japanese speakers.

I've watched lots of anime in Japanese, and while some anime uses simpler language and has voice actors who speak clearly, the vast majority just goes in one ear and out the other either because it's too fast for me to even register what is being said. It's like that with books and YouTube videos as well.

Of course, I can grasp the main "most important points" of whatever I consume. I was able to understand the basic plot points and character motivations/personalities in books like 地球星人、コンビニ人間、かがみの独城、etc. And I can understand lots of slice of life anime and the majority of Freiren, however I really struggle with details. YouTube videos and podcasts are largely impossible for me to understand.

Of course, sentences are hard to understand when I don't know the words, but I have found that occasionally I am unable to understand a sentence even if I know all of the words in it. (this may just mean I need to review important grammar points/particles). It is most common in YouTube videos and anime, but occasionally happens in books as well. I will try to work out the definition in my head, but when I double check with translation I'll realize that I misunderstood the sentence in a really crucial way. I've found that often, I would have used completely different words to express the same concept in Japanese.

This might just be a plateau that I have to spend some time in before I see improvement, but it's been very frustrating. Does anyone have any advice/experience with this sort of thing?