I have had similar conversations with people I know. I ask them if they have a skill to offer other than the ones I have and the answer is usually no. I tell them that if they had taken the money their family spends on their vacations for the past 10 years, they would be ready too.
Everyone thinks you owe them something. I am the type to always deposit more in a relationship account that what I withdraw. Some people do not realize that and have to be reminded of everything you ever did for them and take a look at what they have done for you.
The result is normally pretty humiliating to them and if they walk away then good riddance. The only people I have sympathy for are the ones that are working so hard and can hardly make ends meet from no fault of theirs.