Look Back to Move Forward