Is brain size related to evolution?

How do scientist know what the brain sizes were if they cannot reliably reconstruct an entire scull from fossilized remains?