In a medium bowl mix flour, baking soda baking and powder, cinnamon, cayenne, salt and nutmeg
In a large bowl add softened cream cheese and butter. Using an electric hand mixer, mix until light and fluffy. Add in sifted powdered sugar about 1/2 cup at a time and mix until incorporated. Add in vanilla and mix until combined.
Place one of the cake layers on a cake stand or platter and top with about 3/4 - 1 cup frosting. Smooth it out and place another cake layer on top and repeat.