Using an electric mixer, whisk together milk and powdered sugar.
Add in the dry pudding and mix for 1-2 minutes.
Once it looks thick fold in the whipped topping. Store in the freezer until you're ready to use.