That was the advice I received when I first got started. My tool set is basic and works very well for me. I use a piece of rail road rail for an anvil. My most used tongs are a large set of vise grips. They were invented by a blacksmith to make a better set of tongs. My forge is a break drum forge. Very easy to build. I use 2" black iron pipe for the ash dump and air blast. Purchased from a local plumbing supplier. For my air blast I use a small shop vac called a bucket head. Cost $20 at Home Depot. Just put it on any 5 gallon bucket. To control my blast I use a light dimmer. Again, purchased at the Home Depot. Hammers are easy to find. Use ball peen hammers. I have 3 sizes 16 oz., 24 oz., and a 32 oz. Also I have a good set of files I scrounged and a couple on Nicholson files I purchased at a local store that sells welding and steel working supplies. I have an inexpensive cross peen that I purchased at a farm supplier that is 3 pounds. An angle peen that is 2.25 pounds and a straight peen that is 2.2 pounds that a very nice smith here on the forum sent me to help get me started. And a couple of others that I use for driving or cold work. For a hot cut hardy I use an old hatchet head locked in a small bench vise. Works great. I found a nice post vise at an antique dealer for $40, he wanted $45 but I talked him down $5.
I've made 3 pairs of tongs so far. I work hard to make them as nice as I can. But, they are ugly. Functional, but not pretty.
I forge as often as weather and time will permit. Study when I can't forge.
All together I probably spent about $120 and have about $400 total in value in tools. So a good but basic set can be had for not a lot of money. If your a better scrounger than I am you can reduce that even more.
I know people here have started with less. Don't be discouraged, keep working towards your goal and keep hammering.