Not planning to overvolt but especially the Nvidias can go 120% PT and e.g. the 1080ti can do 2050 Mhz+ 
Overclocking without increasing the voltage is totally safe.
Just keep increasing the overclocking in small amount to know the limit of you GPU, over the limit GPU won't work (until reset).