Yes, with "dd" you should get a low-level bit-wise copy of the underlying blockdevice. Also if you already found other matching files this indicates that you got the correct device (where /data partition was stored on).

If you cannot find the data inside the dump, it may have been already overwritten or fragmented by the filesystem. I'm not an expert but in this case it may be very unlikely (or even impossible) to recover your keys.