Introducing the notions of quenched and annealed probability measures, a systematic study of some problems in the description of spin glasses is attempted. Inequalities and variational principles for the free energies are derived. The absence of spontaneous breakdown of the gauge symmetry is discussed and some high-temperature properties are studied. Examples of annealed models with more than one phase transition are shown.