People have to feel good enough themselves. No one else can give you that sense of self-worth. If it's dependent on others, it can be as easily given as taken away.
The society hasn't been built on exploiting men. It's built on oppressing women. That's what a patriarchy is. The system is built to give men an advantage. Emotionally aware men who are second guessing their every move likely aren't as emotionally mature as they think. If they were, they'd be listening to women and then doing the work of researching what's being said to better understand it.
Another person can make us feel loved but they can't ever truly give us self-worth. We all have to do the work to find that for ourselves.