You can buy a lot of those chemicals in Walmart and Lows in the US (ex: Walmart usually has fairly pure concentrated sulfuric acid. Lows has most common organic solvents.) The lab equipment is also pretty easy to buy on amazon (I’ve bought some trying to teach myself, although I’d recommend against buying anything from China, It always seems to disappear somewhere around LA.)

There’s an entire community of autodidacts that do this sort of thing at home as a hobby. They have lots of advice on PPE, materials handling, storage, where to find papers and books etc. Some of them even record experiments instead of just writing them down so everyone can watch.