Keep What We Have Been Taught