Understanding color variation with site distribution in inverse spinel structure via neutron diffraction, Magnetism, and optical studies