Yes, a lot of people are indeed shallow and are attracted only to people with "good looks", good jobs, etc, but would you really want such a simple-minded (and possibly exploitative) person in your life? Besides, beauty is subjective: What many people find attractive often seems boring and doesn't appeal to me at all, and some people often described as "ugly" are rather cute and interesting to me. Don't let poor experiences with average people blind you to the fact that there are decent people out there who will appreciate you for who you are rather than just judge by external appearances. You probably just haven't met one these yet, and must persevere.
I think we must be careful not to give in to irrational thinking styles that unnecessarily limit our real potential (and depress us) by deluding ourselves that things are worse than they really are. Psychologists call these "cognitive distortions". Here's a list of some common ones:
http://healthymind.com/s-distortions.html
It's made a significant difference to my life to learn how to recognize and challenge this sort of thinking in myself, and I hope it will for you as well. It can be a long learning process, but it's quite worth it I think.