The group of homotopy self-equivalence classes of a topological space X probably first appeared as the mapping-class group of the torus in the book by Clebsch and Gordan [1866], implicit there in the theory of elliptic functions.