I think you should be giving as much credit to the animators as well, if not more. Serkis' mo cap data is a starting point which is then refined by animators. So it's anybody's guess as to who should be given more credit.
Animators get credit for animation, Andy Serkis for his voice, facial expressions and body language, which is more important.