Instead of calling dh_installman multiple times just call it once. List the manpages that should be installed in package specific debian/package.manpages.