Memorizing a passphrase is good assuming you are using it on a constant basis, but if you are not then it's very likely you will forget it. If you repeat this process once a week then that should be sufficient but alas humans are forgetful, and it's always good to have a written or digital backup somewhere.