Generalized polarized manifolds with low second class