It seems that Bitcoin Core is affected by 2038 year problem, I set my clock to 0x7fffffff and the client is halted with this assertion, because when reaching 0x80000000 it is treated as a negative value.
IIRC Bitcoin protocol use unsigned 32-bit/4-byte int, so the problem is on Bitcoin Core implementation. For reference, what Bitcoin Core version did you use?