Underdark was kind of divided like that, yeah. There was the Upperdark, Middledark, and Lowerdark. You could meet most anything in the Upperdark. Low level encounters could be myconids, duergar, derro, orcs, goblins, shriekers, piercers, stirges...probably a bunch of other low level dungeon...