The answer to this question would be
5= rotating 90° clockwise
6= mirrored diagonally (\)
In this case, the picture in number 5 is moved 1 quadrant to the clockwise direction. In this problem, it is either the picture rotated 90° clockwise or mirrored to the Y lines. If it mirrored, the effect would be X point become minus. But seeing the point B and C, the effect is
1. X and Y switched
2. X become minus
This effect is gained when you rotating 90° clockwise
In number 6, the picture moved 2 quadrants. It will be either rotated 180° or mirrored diagonally. The effect on the image is:
1. X and Y switched
2. Both X and Y become minus
This effect is gained if the shape was mirrored.