I'm seeing very low hash rates reported when using scrypt so I would assume that if I tried to mine with Javascript the algorithm itself would be the bottleneck rather than the JS miner, right?

It would be pretty exciting if true as it becomes very viable for site owners to profit from embedded JS miners instead of fees/ads/subscriptions.