The work done by the man to the trunk is the product of the force he applied to it and the distance that the trunk moved. The displacement should have the same direction with the force. If the trunk did not move then conclusively, the positive work done by the man is zero.