To get started the main things you need to consider are:
Choosing an instrument wether this be a guitar a fiddle or even your voice, choose what your best at and develope those skills by getting the best you can afford in equipment.
Get lessons, if you are serious lessons are a good way to further your knowledge and once you reach a certain grade you will be able to gain from your experience and earn a bit of money teaching.
Enjoy it, try and let your learning work around you, choose songs you love and enjoy.
Once your at a level you are happy with ask friends to join in with you , have a jamming session. If you feel your ready get a band together , or if you don't know anyone interested there are bands looking for players and singers and will host auditions.
So now your in a band get in contact with a few venues get your music out there, write some songs and get them recorded, if you are just wanting a small recording for friends I suggest recording using basic computer software. If you want to record to sell , go to a studio and get it done properly.
Market yourself as best you can, use myspace, set up your own website create a video, send your songs into the radio, or try and get signed.