Ctrl/Shift/Alt/Super layers work a little differently than the Base layer and Mod/Mouse/Fn layers.
Here’s a couple of threads that explain the differences in more detail. It’s probably a good idea to skim through it all, especially maexxx’s comments, as he has a way of explaining things concisely: