Massacre Time

In New Mexico, Tom Corbett is a prospector who receives a message from a family friend named Carradine, telling him to return immediately to the home where he lived with his wealthy widowed mother. Years earlier upon her death, she left the house and land to Tom's brother Jeff, and insisted that Tom be sent away. Money was dispatched to him to support him, but her dying wish was that Tom stay away from Laramie Town. Neverless, Tom says goodbye to his foreman, Murray, and rides off.
Upon arrival in Laramie Town, Tom finds the house where he grew up in derelict. Tom is told by two rough-looking thugs to leave because the land belongs to a man called Mr. Scott and warned to beware when he sees the Scott sign which is a big letter 'S' stamped onto a big letter 'J'.
Riding back into town, Tom sees that the Scott sign is all over town, on the bank, the saloon, everywhere, and soon sees why the owners are afraid. Jason Scott, a wealthy businessman, rides into the town square with his sadistic son Junior Scott with a large posse of thugs surrounding them. The Scotts apprehend a family moving out of the town because of the low wages the Scotts pay them. Junior suddenly kills the elderly couple's teenage son in cold blood and laughs mechanically.
Asking around where Jeff Corbett is, Tom is led to an elderly Chinese blacksmith, named Sonko, where Jeff works. Sonko directs Tom to the residence of his employee. Tom finds Jeff living in a run-down shack on the outskirts of town along with their old Indian housemaid Mercedes. Jeff is revealed to be a drunkard, having never gotten over the loss of his mother, as well as the farm. Both Jeff and Mercedes insist that Tom leave immediately and they refuse to discuss why Tom has been summoned. They are also anxious that Tom shouldn't be seen by anyone else in town who might recognize him. Determined to find out what is going on, Tom rides back into town, observed by a few of Scott's men.
That evening at the local saloon, a bar-room brawl erupts when Jeff follows Tom and gets roughed up by Scott's men. Jeff handles himself admirably in the fight, despite being drunk. Tom joins the fray after watching his brother's antics, and the two of them stagger out together. However, Jeff continues to insist to Tom that he leave town. Instead, Tom visits the Carradine family to find out why the letter to him was sent. But before Carradine and Tom can discuss anything, a massacre erupts. The Carradines are all killed by shadowy assailants, but Tom escapes unharmed.
The next day, Tom learns that talking to the townsfolk about Mr. Scott only leads them to give dire warnings. Tom decides to go out himself to the Scott ranch to resolve what is going on. Jeff offers to come along with him. Despite being drunk, Jeff's shooting skills have not been dulled by his tequila intake. Jeff single handedly shoots six of Scott's men, plus three more at a guard post to help Tom approach the isolated Scott ranch; after gaining Toms promise that he will take the responsibility for having killed them.
Tom walks into the Scott ranch to find a high-society party in progress. He confronts Scott, but the wealthy man refuses to talk, claiming he's too busy with the party. But Junior is not so different. He gloatingly demonstrates his dexterity with a whip, giving the struggling Tom a protracted and humiliating beating in front of the assembled guests.
Back at Jeff's shack, a battered Tom is tended to by Mercedes. But a shadowy gunman passes the window and kills her. Enraged, Jeff resolves to join his brother's quest for vengeance against the Scotts. He tells Tom that a few mothers earlier, the Scotts had his father killed. But when Tom responds with "our father?" Jeff snarls, "I said MY father."
The two men encounter Mr. Scott at a remote, tumble-down shack where Jeff finally reveals his secret: Mr. Scott is really Tom's father. Tom and Jeff are only half-brothers. Mr. Scott reveals that it was he who sent for him for he wants Tom to live at the ranch with him as his heir. Mr. Scott had no part in the killings of Tom's father, the Carradines, or Mercedes. He trembling informs Tom that Junior, Tom's younger half-brother, is insane having been spoiled all his life by wealth and power, and is afraid that Junior has gone too far with it. Before Mr. Scott can go on, Junior appears and shoots him dead. The rest of the Junior Scott party rides back to the ranch.
Jeff is tempted to leave the rest of the matter as a family affair, but relents and accompanies Tom on his mission to bring down Junior and his henchmen. In a long and climatic gunfight, Tom and Jeff assault the Scott ranch and kill all of Junior's henchmen. During the battle, Jeff saves Toms life from Junior when he shoots the gun out of Junior's hand as he's about to shoot Tom in the back. The insane youth retreats from a bare-knuckle fight with Tom, and to a tussle on a narrow wooden walkway between two ranch buildings. After a brief fist-fight, the maniac Junior looses his balance as he tries to wrestle Tom over the side and instead falls to his death, landing in a dove-coop. As a several white doves fly into the air, the drunk Jeff makes as if to shoot at the birds. Tom's hand gently lowers the muzzle of Jeff's gun and shakes his head meaning that there's no need for anymore shooting.

Question: What are Jeff and his wife anxious about?
Answer: That Tom shouldn't be seen by anyone else in town who might recognize him.