The colors shown in the VFB are NOT the cryptomatte. Those are just a quick visual representation, and should not be used for masking etc. in post. Not even when saving to CXR / EXR :) That is still not the actual cryptomatte. It's there just to let you know cryptomatte is working and give you some idea of how it is dividing things up depending on how you have it set.
Instead, once saved as CXR (and renamed to EXR) you will find when using EXR-IO (without it, Photoshop won't load the file properly) that there is a separate layer for each... well material or object for example, but it depends on what you selected for the cryptomatte. Those individual layers are the actual masks that should be used in post.
You can see them in the video at
t=204 - and indeed you should watch the whole video. That color pass / element should just be thrown away and never used other than as a check on "is cryptomatte working?" when rendering :)