It's not wrong to be attracted to what is good and beautiful. In fact, God is the one who created every woman's beauty, and all beauty is a share in his. So, God is not upset if you're amazed at his creation. Let the beauty of every women remind you of the infinitely greater beauty that awaits you in heaven, if you persevere in purity.
When you see an attractive woman, feel free to thank God for her beauty. You could even use the words of Psalm 84: "How lovely is your dwelling place, Lord, Mighty God." In ancient times, this passage referred to God's dwelling place, the temple of Israel. But in the New Testament, our bodies are considered God's temples (1 Cor. 3:16; 6:19). Therefore, allow the beauty of God's creation to remind you of him.
On the other hand, realize that sometimes God does not want to be attractive to us. That might sound weird, but Mother Teresa used to speak about how she would pick up dying people from the street who were covered with maggots and worms. She recognized the face of Christ in them, but it wasn't easy to look at them. What God cares about is the intention of our heart. He does not judge us by our attractions. In fact, because these sick and dying people were so difficult to look at, it was all the more virtuous for Mother Teresa to love them. She will be given a greater reward in heaven for overcoming her natural desires to look away.
Sin is usually more alluring than virtue. That's why it takes strength to choose what is less attractive in order to do what is right. For example, when we fast and abstain from meat on Fridays in Lent, it's not a sin to be attracted to a steak. In the same way, when Jesus was in the desert, all the things the devil promised him were more attractive than the desert and the cross. But their attractiveness is not a sin. Likewise, it is not wrong for you to be drawn to something good, especially a human person. Ultimately, your virtue or vice is determined by what you do with such attractions.
So be at peace if you find women to be amazing. You're not alone.