Earlier I downloaded the "Microsoft Visual Studio Tools for the Microsoft Office System" and now I see there's a "Microsoft Visual Studio 2005 Tools for the 2007 Microsoft Office System" download that is available.
I had to remove everything because I was experiencing problems when trying to run in debug mode (The ApplicationStartUp event was not firing, but that's another story). Now I get the following error which occurred after I remove the first VSTO install and then installed the latest.
"The Visual Studio Environment Menu Package ({715F10EB-9E99-11D2-BFC2-00C04F990235}) did not load because of previous errors. For assistance, contact the package vendor. To attempt to load this package again, type 'devenv /resetskippkgs' at the command prompt."