The Lee anniversary kit has about everything you'll need except caliber specific items like dies and a case length gauge. Their equipment though less expensive than most is quite good and loads some really good ammo.
I would also recommend Modern reloading by Richard Lee as a very good manual to start with. If you read it all from the beginning up to the load data you will have a pretty good grasp of the fundamentals and should be ready to start reloading. I would also recommend their deluxe die set. It comes with a neck sizing die that sure makes things easy as case lube is not required when using it.