Heat oven to 350°F (325°F for dark pan). Grease and flour bottom only of 9x5-inch loaf pan. In large bowl with electric mixer, beat sugar and butter on medium speed until creamy.
Add eggs, milk, vanilla and bananas. Beat about 30 seconds or until well blended. Add all remaining ingredients except candy. Mix just until moistened. Reserve 2 tablespoons cut up candy. With spoon, fold in remaining candy. Pour into pan.
Bake 1 hour to 1 hour 10 minutes or until toothpick inserted near center comes out clean. Cool in pan 10 minutes. Remove from pan to cooling rack. Finely chop the reserved 2 tablespoons candy; sprinkle on warm bread. Cool completely, about 2 hours.