He's not giving it up easily