The ecu changes target idle speed very slowly. The surge is not from the ECU rapidly modulating the ISCV.
You can get a feel for how slow it is by driving with a cold engine on the freeway until it warms up, then pulling to stop. The idle speed will be initially high since the ECU has only the cold idle speed data in memory, then it will slowly ramp down to the usual 650rpm over many seconds, it is not fast at all.