Remove the passion fruit pulp from the shell with a spoon and place in a blender. Add the banana, milk and yogurt and whisk to form a smooth shake. Do not mix for too long, otherwise the shake can become very thick and frothy. Add a little more milk if necessary.