I read somewhere that cats rarely feel attached to the owner, but rather to the house. Cat goes where the food is and doesn't care who provides it, that's why people who steal cats and have no problems keeping them in their new home.
you've just broke my heart

i wanted to carry on living in my little bubble where my cat actually loves me and not just my house
well thats the hardest truth mate

cats will never leave your house as long as there is a food on the table

but its still depends whether your cats is only adopted or born in your house