Every address is like a door with a mail slot.  Anyone can drop coins in the slot from outside, but to get access to the coins that have been dropped in the slot you need the key to the door.  The wallet.dat file contains the key to the door.  If you lose that key you'll never be able to get the coins inside.