Your parents are right. The bride's family shld get priority when it comes to the wedding venue and plans.
Your hubby shld find a way to get his family and friends here. He can't have everything at his own convenience.
I agree with 4Him but some other things still have to be put into consideration.
Will it be easier for your Fiance's folks to come to US for the wedding or the other way round for your parents? You said almost all your family members and that of your fiance stay in Nigeria. Now except if you don't mind having a wedding with only your parents and a few guests in attendance, I think you should consider having it in Nigeria. Weddings in Nigeria are 'family affairs', where every extended member of the family incuding great-grand uncles will like to attend
Talk to your parents and weigh the options available. As per the wedding venue and plans, that should be your family's prerogative. The Wedding should be in your own Family Church not that of your fiance.