Indeed. If you try a new pool, you need to leave your miners on it for at least 72 hours straight, and measure your earnings for that time period.