Stir together the sugar, cinnamon, and nutmeg in a medium bowl.
Add the milk, eggs, and vanilla then whisk to combine.
Transfer batter to a large shallow bowl for dipping.
Using a medium sized skillet, melt 2 tablespoon if butter on medium heat.
Dip both sides of a bread slice in the batter. Place in the hot skillet and cook 1-2 minutes in both sides until golden brown. Repeat with remaining slices. Add the final 2 tablespoons of butter halfway between cooking the slices to keep skillet buttered.
Place slices on serving dishes, stacking as many slices as you want to serve. Then top with warm apples and drizzle with the apple syrup.
Top with a dusting of powdered sugar and/or maple syrup if you like.