This book constitutes the refereed proceedings of the Second International Workshop on Analysis and Modelling of Faces and Gestures, AMFG 2005, held in Beijing, China in October 2005 within the scope of ICCV 2005, the International Conference on Computer Vision. The 30 revised full papers presented together with 2 invited papers were carefully reviewed and selected from 90 submissions. The papers give a survey of the status of recognition, analysis and modeling of face and gesture. The topics of these papers range from feature representation, robust recognition, learning, 3D modeling, to psychology.