Later in chapter three Slim agrees that Candy's dog should be put down and offers Candy a puppy. The old man is distraught and doesn't respond to the offer. Carlson uses his Luger to shoot the old dog. The purpose of the scene is to provide foreshadowing for George's eventual shooting of Lennie in chapter six.
HOPE THIS HELPS