These transactions do still exist inside of orphaned blocks.
Blocks get orphaned all the time, and as far as I know the orphaned transactions aren't abandoned, they're just added to other blocks again. That makes it very unlikely to find a transaction that's not in the main chain this way.