Windows makes it easy (although not obvious) to customize the Taskbar with custom icons ... To break it down simply, you need two things: A folder with all the icon files for your taskbar apps.