Thermodynamics and probability theory have something in common: the idea of entropy. What exactly is entropy? How can it be understood on an intuitive level without to much mathematics? This is an introduction with simple ideas from physics.
WP: Entropy WP: Probability theory WP: Thermodynamics