Yes it can take a lot longer than that if you're syncing from the beginning.  If you want to speed the process up you can download the PIVX blockchain from: http://chain.pivxstatus.com/