Well hopefully the new version of cgminer (3.2.1) that has a significant bugfix for these devices will allow people to move to it instead of sticking to the old version.
Compiled it on my Pi and it looks like as if it does perform much better with lesser HW errors still on diff 1 (check my previous post). Also, no need for additional options just like with 3.2.0. Thanks ckolivas and kano for the fast cgminer updates. Here's an addition to my previous post to get my test build to 3.2.1. Stop cgminer and do this:
cd ~/src/cgminer
make clean
git pull
./autogen.sh
CFLAGS="-O2 -Wall -march=native" ./configure --enable-bflsc --enable-icarus --enable-bitforce --enable-modminer --enable-ztex
make