Preheat oven to 350 degrees F and grease a 9x13 pan or 2 1/2 quart baking dish.
In a small dish, mix nutmeg, salt, and pepper.
Alternate layering each kind of potato, sprinkling the spice mixture onto each layer.
Pour cream and milk on the potatoes. Smash the potatoes down if not covered in the cream.
Cover the pan tightly with foil and bake for 1 hour and 15 minutes or until potatoes are tender.
In a bowl, mix panko, parmesan and melted butter together until moistened. Sprinkle evenly over the top of the cooked potatoes and pop back in the oven to broil for 3-4 minutes or until golden.
Let potatoes sit for 5-10 minutes before serving.