Beat the egg until well beaten, add remaining ingredients including one teaspoon zest from lemon and orange.  Pour into a saucepan and cook over medium-low heat; stirring constantly until the mixture is boiling around the edges and thickened.  This will take 8 - 10 minutes.  Immediately remove from the heat.  Cool.  Refrigerate.