In a medium bowl, beat egg yolks with 1/4 cup sugar until creamy. Set aside.

In a medium saucepan, combine the remaining 1/4 cup sugar with the oat flour, salt and nutmeg.

Add the almond milk and cook over medium heat, stirring constantly until the mixture has thickened, about 5 to 7 minutes.

Stir a little bit of hot filling mixture from the saucepan into the yolk and sugar mixture to temper it, then add the yolk and sugar mixture back to the saucepan, stirring constantly.

Continue stirring and cooking for 2 more minutes over medium heat.

Remove from heat and cool to room temperature.

Add vanilla and almond extracts to cooled filling and stir until thoroughly incorporated.

In parfait glasses or other decorative dishes, layer almond cream and sliced bananas, ending with the almond cream.

Chill in the refrigerator at least one hour.

Garnish with toasted almonds and serve with dairy-free whipped topping, if desired.