Using the sample size calculator, I get a sample size of 1514 people with a 99.99% confidence. So for a comparison between men and women, then 757 men and 757 women should be surveyed to enable to determine which group participates in regular sustained physical activity.