I'd got for the stainless - it's by far the easiest option if you haven't much experience (yet). Plus, it's easier to get a reasonable stainless steel knife at the lower end of the market than a carbon blade.
Your question has so many answers simply because there are so many different types of steel - 440 A, B, C, V, ATS-34, blah blah blah . Fortunately, if you're paying less than 50 quid, your options dwindle, giving fewer choices.
Don't get me wrong, there are plenty of good, cheap blades to be had. I've owned knives which cost more than £200 but at the moment I'm using a knife which cost less than 30 quid and I'm more than happy with it.
Once your collection and experience grows, you can get a carbon steel knife - Anthonyyy's comment, whilst sounding obscure, makes a lot of sense