Anyone else have similar experience? Can it be a sign of manipulation?
Yes. NO.
Pools calculate hash rate based in the number of share submitted. If you don't submit shares your hashrate is zero.
It has nothing to do with solo pool vs shared pool. High stratum difficulty will reduce share rate and make pool's reported hashrate more volatile.