I would suggest you to replace bitcoin core with Electrum wallet but keep following the other rules like stronger passwords, updated antivirus and secure location etc. Bitcoin core will only take up space in your computer hard disk and  for ordinary persons like us, it will not add any value.
If you have bitcoin in big quantity, then a hardware wallet is recommended but then you should be able to keep the wallet and its private key in a safe location.