I have the same trouble. Never worried me much. It's back flow from the cylinder head connector.
ICV/intake & general vac hose leaks cause much of the same trouble. When you have leaks in the hoses, the idle suffers and vacuum drops. Then oil isn't pulled from the system very well. I'd also check the big vac hose that connects under the TB (goes to the heater crossover then the ICV) as that will have a lot of oil too.