The alternator creates a lot of load for the engine to turn with electronics on, but it shouldn't be that dramatic. With lights and everything running, I only lose about 100 rpm if that. I'd guess a vacuum leak, as that seems to be the usual culprit.
As for jerkyness at low speeds, that is caused by drivetrain backlash. There is a good bit of slop in any car's drivetrain, and if you are driving at >10 mph in first or are idling around in second, the car will jerk. It shouldn't be noticeable on liftoff unless you let of the throttle abruptly, and bushings are the normal culprit, mainly the rear subframe. you already did that though...