If the ban is temporary and gets lifted in 7 days or whatever the time is, the member can either keep using the newly created account or can abandon it.  It can't be deleted.

If the ban is permanent, the member isn't allowed to keep using the new account unless it's to appeal the ban in Meta.