Yes. It might not be a good security practice, as your new server won't validate the blocks again, but if you trust the data, sure.
You will need to copy everything though, not just the blocks directory, but chainstate as well, otherwise it will start block validation process from the beginning.