This is a known bug in implementations that don't treat the key derivation as key derivation (similar to any KDF purely working with bytes instead of constantly converting between byte and int)! It was found 5 years ago and the BIP already has a test vector for it: https://github.com/bitcoin/bips/blob/master/bip-0032.mediawiki#test-vector-3