Why Are Capillaries So Small And Thin?

They are thin because it allows more efficient diffusion of oxygen and nutrients into the blood and of carbon dioxide and other waste products out of the blood.
They are small because it means that the red blood cells are pushed against the sides, which also makes for more efficient diffusion.