My question is, when I delete the wallet.dat, will Bitcoin Core generate a new one for me ?
Yes. You will be able to create a new one.
You can create as much wallet files as you wish.
And if you have just created a wallet for testing purpose and didn't use any address, you can safely delete it without running any risks (even though just renaming it wouldn't hurt).