"the ones that look like the 'quick launch' icons--- "
If you are referring to the quick launch buttons, it's simple. Right click on a blank spot on your taskbar, then from the pop-up menu, choose: toolbars---->quick launch. You can drag and drop icons of programs to that area, and they will show up on your quick launch bar