Sprinkle sugar over each of the peach halves. Place peaches face down on hot grill. cook for 5-6 minutes. Flip peaches and cook for another 5-6 minutes or until peaches are soft. Remove from grill and let cool. Dice peaches and pound cake into chunks.
To assemble the parfaits pour some of the caramel in the bottom of the dessert dish. Layer pound cake, then some whipped cream followed by peaches and more whipped cream and top with chopped almonds.