This book constitutes the refereed proceedings of the First International Workshop on Human Behavior Understanding, HBU 2010, a satellite workshop of the International Conference on Pattern Recognition in Istanbul, Turkey, on August 22, 2010. The 13 revised full papers presented were carefully reviewed and selected from 29 submissions. The papers are organized in topical sections on analysis of human activities; non-verbal action dynamics; visual action recognition; and social signals.