For Forum software, I will recommend Xenforo (even TE is using Xenforo, so that says a lot :p).
Regarding Hosting, it depends on the location of your visitors. Visitors from where will you be targeting ?
Secondly, regarding VPS/Shared, i would say start with a good shared hosting plan first, and...