You're saying that a bino with a 4.2 mm exit pupil lasted longer in low light than a scope with a 7.7 mm exit pupil.
I don't know how dark "dusky dark" is. If that means 15-30 minutes after sunset, your eye pupil was probably about 5 mm. Your age and the actual light level are big factors, so it's difficult to guess. If your eye pupil was 5 mm, that means the Nikon had at least 40% better transmission than the Vortex. It seems unlikely that the Vortex transmission could be that low. A scope can only lose that much light because of the anti-reflection lens coatings. The coatings would have to be really bad to loose 40%. If that were the case with all Viper PAs, a lot of other hunters would be complaining.
I'm left with the conclusion that "dusky dark" was at or before sunset, and your eye pupil was closer to 4 mm. In that case you were seeing the difference between Nikon and Viper PA anti-reflection coatings, which could be as much as 5-10%. That's a more likely scenario.
Another possibility is that the lenses on the Viper were dirty.
If it was substantially after sunset and the Vortex lenses were clean, you should contact Vortex.