You're not mistaken, and there is a trait for weapons and armor that does the same thing at different percentages (depending on the quality of the item). I'm pretty sure that these stack.
This is why I took dual wield as my secondary after bow, even though 2H seems more ideal for close range PvP burst damage.
edit: Tearofsoul, light armor helps your magicka, medium helps your sneak, and heavy helps your defense (with increasing armor from light to heavy of course). Most casters do a mix of light and heavy to get the magicka and casting passives but balance it out with heavy armor. With the soft cap in place, that's viable without sacrificing effectiveness as a caster by endgame.