Not Necessarily. There is an old Persian saying that goes, Men are led to the bed chambers by their eyes, women are led by their ears. I, in my experience, have found this to be true. After all, I am known as a funny guy by my friends and when I was single I did ok with the ladies and am now married to a women considered very beautiful by many. I'm not saying looks are not important to women but they are more likely to overlook physical flaws when a great personality is present. Much more so then men do. I believe its because, whether or not our male egos wish to accept it or not, they are more socially and emotionally developed beings.
And remember one more thing. Who we are fundamentally as people, ie personality, changes little over time. Our physical reality is constantly changing. In other words, we get ugly faster than we think(age). You cant do much to change your physical self without expensive and risky surgery, so work on and develope what you can. You as a person.