It's even better to physically turn off/remove antennas if you can.
But it's quite hard for average person, even if you have appropriate tool and guide (usually from iFixit). I doubt you could remove the battery without exposing the motherboard. Almost all phone doesn't have physical switch either, unless you're willing to use niche device such as PinePhone.