According to research published in Research in Nature Neuroscience, people with a busy social life appear to have more volume in a specific part of the brain called the amygdala.

(The amygdala region of the brain is already linked to emotional and mental well being, and now it appears to be larger in people with complex social networks.  So it looks as if size does matter.)