p2pool always worked like that, PPLNS, you gather shares while mining, then every single block solved by p2pool will include you in payouts as long as you have valid shares in p2pool share chain (that number will decrease with others mining after you stopped)