But I know some people get annoyed
It's true - I don't have kids or a mortgage. Technically I am single - in that I am not married - though I am not really sure how that fits in with the ability to travel. Maybe because I am not responsible for someone else financially? If so, then yes, that is true.
But none of that is "luck" - it's choice. I chose not to have kids, I chose to sell my house so I would not have the financial burden, and I choose to be with someone who doesn't need my financial help. I have worked very hard at jobs I have not always loved to earn the money and time to be able to travel.
Make no mistake - I am blessed to have all of these things, and I am grateful everyday.
But it was not "luck." It was hard work and smart choices. There is definitely a difference.