Starting a business does not necessarily mean you have to have a lawyer and accountant and file a ton of paper work. You may already be working as one of the simplest and cheapest business structures already - Sole Proprietor. You can be a sole proprietor if you sell keychains for heaven's sake. LLC's are popular too but if you are not ready financially to take that on and your business is simple enough, you could jus begin as a Sole Proprietor.
You can still have some tax deductions, you can still get an EID (a social security number for businesses) and still open a business bank account or brokerage account.
Have you heard of the term Sole Proprietorship before or do you have one?