Time and a whole lot of practice listening should do the trick. It seems overly simple but in the very long run, it works.

Obviously, the more you compound this with active study of grammar and vocabulary, the faster you’ll understand more.

Bonne chance!