But would it also be the case outside of swaps, say if the party I'm sending an LN payment to is offline, or if I shut down after sending an LN payment but before they receive it (for whatever reason)?
You can't send Lightning payments to offline nodes. If you disappear while your Lightning payment is being routed, your channel might end up being closed uncooperatively by the other party.