The ICV should have a rest position when it's not powered. You might have some troubles with emissions testing, but you could just plug it back in.
I don't think it'd have much negative effect, since I think a plugged up one is worse for the car than none at all. You might get some hard starts when the car is cold, and some stalls when you abruptly let off the gas. From what I've seen it's more for tweaking the idle than anything else.