It is proved that the polaronic and bipolaronic structures found in the adiabatic Holstein model at large electron-phonon coupling by Aubry, Abramovici, and Raimbault survive under connection of the electrons to a low-temperature heat bath, uniformly in the size of the system. Bounds are computed for one-dimensional nearest neighbor chains, and some sample solutions are continued numerically.