The cat might be sad for a few days but it will eventually move on. They are intuitive enough to figure out that new people are now living at this house. Cats are natural hunters so they will know how to survive when you are gone. You are probably not the only person in your area who feeds stray cats so I am sure it will be fine and find a new place to visit for dinner.