In this paper damage propagation during metal forming process is investigated with the concept of continuum damage mechanics, An isotropic damage model based on the theory of materials of type N is adopted to describe the damage process of a ductile material with large elasto-viscoplastic deformation. To solve the finite elasto-viscoplasticity problem, a reasonable kinematic strain measure for largely deformed solids is used and the damage constitutive equations based on thermodynamical framework are developed. The stiffness degradation of the loaded material is chosen as a damage measure. An extended interior penalty method is used to impose the contact condition on the boundary. The highly nonlinear equilibrium equations are reduced to the incremental weak form and approximated by the total Lagrangian finite element method. The displacement control method along with the modified Riks' continuation technique based on displacement parameter is used to solve the incremental iterative equations. As numerical examples, upsetting, backward extrusion and punch problems are simulated and the results of damage propagation and -/2 stress contours with and without damage are presented. For punch problems, spring back and residual stresses are also presented.