It is possible to transfer color while preserving texture with the following trick. First use your base image as the style which you transfer to the image you want to use for its color, preserving its color. Then transfer the result as style back to your base image, not preserving color.