Some more thoughts - a bit of a ramble, really ....
Do you feel the same way about other things? For example do you think people who are very intelligent, or have superb physical skills compared with others should feel guilty about it and should avoid developing their gifts. Or should people born white feel guilty about that, or people who have a gift for music? What about people who are blessed with a long life and go on well into their 90s in good health, compared with those who die young? What about happiness - do you feel guilty if you are generally more happy than others?
Maybe, as others have said, one way to try out a different angle on this is to separate in your thinking what someone has in terms of these attributes from what they do with it. Take someone like Henry Ford, for example, who made a mint out of the car industry, but who made it possible for ordinary people to own a car - before him and his like, only the very wealthiest of people could own one. A lot of wealthy people are in similar situations - we might moan about the tyranny of large corporations like Microsoft and Apple and Samsung, but then everyone who wants a smart phone can have one pretty cheaply these days. When I was a young adult these would have looked like science fiction, yet now they have improved our lives enormously in ways we just take for granted. I know these devices - cars, computers, phones - come with undesirable baggage as well, but the answer to that is not to go back to Victorian times when people were immeasurably worse off than they are now, apart form a privileged few.
But how we obtain and what we do with our personal gifts - our intelligence, our musical skill, our joke-telling ability
, our wealth - that is where the focus on morality should be, not on their actual possession. Even there it's ambivalent - we put up with all sorts of bad behaviour from an actor who is brilliant on screen for example, or from a star sportsperson on our favourite team. To my mind, someone who possesses great intelligence is just as open to this sort of question as someone who is wealthy. If someone is given great gifts, then much is expected of them as it says in the New Testament, and this isn't just looking at wealth.
I have an instinctive repulsion from any sort of levelling, myself. The world is full of inequalities, and these feel very important for the health of our societies. Nature isn't fair as much from necessity as from blind chance. As far as wealth is concerned, a civilised society should ensure that people don't fall below a minimum level, and should be given lots of opportunities to rise up to higher levels, but the sky's the limit as far as I'm concerned. It should also put constraints on people who have very much, to ensure they don't damage or constrain others less fortunate. This isn't an issue just with wealth - we can all see the havoc a political leader with an abundance of intelligence and bullshit can wreak, regardless of how wealthy they are.