A good Yoga kit should not cost you more than twenty dollars and it will include a mat, 2 blocks and a stretching band.
Also, if you belong to a health club, many of them offer Yoga classes and this will help you learn because you will be able to see firsthand what you are supposed to be doing and if the class is small enough, the instructor may be able to correct your posture when you are not getting it right. You will be able to mimic the moves as well as understand the proper breathing techniques by listening to the instructor.
There are plenty of independent Yoga instructors in most areas but it can be a bit pricey at 10-20 dollars per lesson or about $100 per month for an unlimited membership It is very helpful to watch it a few times before you begin to make sure that you are comfortable before attempting the moves because once you begin, you will take your cues from the audio instruction and not the visual since you will be looking up, down or away from the screen. If you enjoy working out in your home then you can buy a book or you can use a DVD to learn how to perform Yoga. This took me a few tapes to figure out. There are many ways that you can learn how to practice.
As you progress through your diet and exercise plan, I want you to seriously consider giving Yoga a try. Yoga has been practiced for thousands of years and will continue to be used by people for their health and harmony.