Are you using the latest 13.2 version of p2pool? Didn't 13.1 have issues with Avalons? Or was that something different?
My node is running from latest git commit:
P2Pool version: 0a3493d
Current local DOA is 5.9% and GBT Latency is < 0.1
Pretty sure the problem is cgminer requiring too many cpu cycles.