I got it running smooth now.
I disconnected the vacuum line from the advance and it made no difference. I checked the advance with a vacuum pump, and it moved as it should. I had the vacuum advance hooked up to the port coming off of the back of the manifold, not the carb. So I changed it over to the one coming off of the carb, and capped off the one on the manifold, re-set my points, re-set the timing and started it again. It idles great, and the acceleration is smooth as well.
So it could have been not enough vacuum from the manifold, or my points/timing being off, but I am leaning toward the vacuum.
Either way I’m good to go now.