I'm a fly fisherman, who has done some float and weight in the past. I'd say get a basic rod, with some bubble floats, size 12 hooks and some split shot, some worms for the bait- doesn't get much more simple than that and if you head to a tackle shop they'll be able to set you up with that for under £30 for decent stuff, good rod and reel etc. You could also get a few spoons and spinners as well.
They're are a few things you'll need to fish legally, a rod licence with the environment agency and a permit for the water you're on, although some are free. You'll likely need a landing net and a priest for most places won't allow you to fish without them.
The fly route is much more complicated- however it's all I really do these days. I had a days casting lesson and lots of help from experienced people we know. It's more complicated and you need more gear which is usually more expensive. Like rod, about 9ft five weight, reels with floating/sinking/intermediate line downing on your style of fishing and conditions, waders, net, assorted flys, priest, polarised sunglasses and a hat to protect you Reyes and head from the line and to help you see fish in the water so you can follow them, a vest is useful, leaders, about 9ft knot less and tapered, line sinkant and floatant etc etc.
You can hobo fish, technically your supposed to have a to to fish on fresh water. Anyway, I hope this has been useful- you should definitely try it, it's great fun!
