Hand rails are the long part along the stairs that you hold when walking up or down.

Balusters are vertical posts that rest in the base and the railing. Though, these do not provide substantial structural support they do prevent people and objects from falling through. 

The long section at the bottom that that parallels the railings.

Newels are vertical support posts at the end of the staircase railing, these are both functional and decorative.