The fundamental principle of counting is important to solve this particular problem. For the first person, we are able to choose from 4 men, for the second in line, we can choose from 4 women. When alternate, the counting becomes,
4 x 4 x 3 x 3 x 2 x 2 x 1 x 1
or it can be simplified to
4! x 4!
Therefore, the answer is 576.