I regularly make gorse wine in May/June from the flowers on Arthur's Seat in Edinburgh, and it is a fantastic drink - when young it tastes quite strongly of coconut, but it turns into a much dryer refreshing wine as it ages - my best bottles are now 2 years+ old.
Its a pain to collect the flowers though - need a shopping bag full, and the thorns get your fingers all the time - they freeze well though, so you don't have to make it straight away (remembers he's got a bag in the freezer waiting to be vinified!)
Gorse Tea is also nice, but you need more flowers than you think to impart a strong enough taste. They're also nice in salads as has already been said.
Quick note at this point, be careful not to get Gorse (Ulex europaeus) and Broom (Cytisus scoparius) confused - while gorse is often used medicinally as a diuretic and blood tonic, too much can be a strong purgative!