Birthday Party Ice Cream Cupcake Recipe: Make the cake batter according to the package directions. When the cake batter is ready, pour 1/4 cup to 2/3 cup of cake batter into each ice cream cone. Once done, place the cones standing up in a muffin pan. Bake for about 20 minutes. Let cool.