Turning Your Critics Into Coaches