When starting a small business, it is important to ensure that you do not overspend on things that you do not really need. Instead, buy only the things that are needed to keep the business operational. Also, instead of buying a whole whack of things brand new, see if you could find a few used items that are in good condition ie. a reception desk, a merchandise display cabinet, a photocopier, etc.
As your business, grows you will be able to afford the extra items needed as your income increases. If possible, plan ahead and save a good portion of money for the start up of a business - this will alleviate a lot of stress. Having some patience and exercising some discipline with spending will increase your chances of success.