Selecting Right Contract

The bidding went (N /S) with EW passing throughout. N 1H, S 2C, N 2D, S 2NT, N 3D, passed out. My partner thought that I should bid 4H, but I thought that without an honour in H I should pass. What is your opinion? (3D plus 2 was a top).