I was very surprised when I learned that the color of an object depends simply on the structure of the surface from which the light is reflected. It turns out that a color is just an uneven surface of a certain type

This isn't exactly right. The wavelengths of light that an object reflects are determined by the arrangement of electrons in the atoms on its surface. Different substances absorb and re-emit photons of varying energies according to complicated quantum laws.
Most plant leaves, for example, contain a pigment called chlorophyll, which absorbs photons of the blue and red colors of the spectrum while reflecting the green. It has almost nothing to do with the uneven surface texture, so we have leaves that are rough or smooth to the touch but still green in color.