Yes. P2pool will send you a transaction for every share you find. It will be small amounts of Monero but there it will be in your transactions.
It actually sends you a share for every block the pool mines while you have an active share. If you mine a share and the pool doesn't get a block, you don't get anything (but this should be unusual if the pool hash rate is high enough). If it mines two blocks, you get paid twice (or more) even for one share.