I started out with a pile of bricks on a paving slab for my forge, a sledge hammer for anvil and a ball peen for hitting with. These days I demonstrate with a hole in the ground for my forge (but I do use more elaborate designs in my workshop)
The equipment needn't be expensive or complicated. My ground level forge is blown with bellows, but ahair dryer will work too. Any lump of metal that can be secured to a log or in a bucket of concrete will do an anvil (avoid RSJ and rail if you can help it) any hammer will do to start forging. If you can find some tongs (ebay, carboot) they are a boon, but a long pair of pliers or mole grips will work in a pinch.
Simple projects to start could be pot hangers, tent pegs and pokers, but you can easily build up the skills to be making toasting forks, coat hooks, etc. Depends on what you really want to be making
Getting the kit together aside. You can definately start forging by gathering the tools and then having a go at simple projects and justhitting the steel to see where it goes. But, it is MUCH easier to be taught how to do it properly! Living in Devon you have access to a couple of great sources for help and tuition. One is the Wessex Guild who run short courses at Westpoint in Exeter. The other is me
I run general forgin courses, but speicalise in tools and blades (got an axe making course on this weekend as it happens)