What is the factor that would speed up time for a single transaction to get a single confirmation the most? Difficulty? Number of miners? Gh/s? etc.
None of the above. You need to include a higher TX fee if you want the TX to confirm in a short amount of time (as measured by number of blocks until the TX is confirmed).