Caper sauce is basically made from caper, a flower bud found on a perennial spiny bush that bears rounded, fleshy leaves and big white to pinkish-white flowers. The unripened flower buds of the plant are used for consumption by first drying them in the sun and then pickling in vinegar, wine, or brine.