Are we allowed to call people who fall for this idiots?

If they fully understand what they are getting themselves into and still do it, yes. If they have been in custody of their own private keys and seeds this whole time, and now with the introduction of Ledger Recover, they decide to use that because holding your own keys is difficult and dangerous, then they are even bigger idiots. On the other hand, if they fail to understand the whole concept of crypto, they should first be pointed towards a better path. If they still go through the dark forest, don't come back crying if you get attacked (if you come back at all).