Ha ha ha, you're just along the road from me. I'm about 3.5 miles to the NE of you, and probably know the exact cave you're talking about, more of an overhang now since the Council filled it in... for safety reasons... in the 1970's, which is despicable as it was one of the holy wells of Medieval Pilgrimages, and probably of far more ancient significance! It's a bit more frequented than you're saying though, although the numb-nuts are accustomed to a much more comfortable life-style these days with surround sound on their home cinemas.
And it's comforting to know that you're treading in the footsteps of a long line of ancestors ranging from last years graffiti, C18/19th lovers, Christian symbols from the cross to the salmon, a longship and evidence Viking visits, the Floral Rods and Z Rods of Pictish kings to the broken symbols of the end of dynasties. And there are marks in the caves far older than is given credit for, mysterious marks by a hand with a different mind-set to ours.
If you look closely at the eroding banks outside the caves, at about 2 - 3 metres below what was surface level, you'll find ancient fire-hearths with bone and shell middens, hammer stones and tools if you're lucky. Although digging into these deposits is both inadvisable, as the erosion layers are unstable, and undesirable, as the site is inspected frequently -you'll see trowel marks- and intrusion disturbs the archaeological record.
Any finds should be reported to Douglas Speirs' Office at Fife's Archaeological Unit.
http://www.fifedirect.org.uk/topics...objectid=CCC7A11B-14C6-47DF-A67B-36D699635AD4
Cherish it my friend, as the entirety of the site is both misunderstood and grossly undervalued!
Pango.