A judge has ruled the Connecticut man must pay $916,000 per year in alimony and child support to his ex, Lorraine Nantz.
The two filed for divorce last year after years of marriage counseling.
Nantz claims his wife lost interest in his television career, which required the network's primary commentator for college football, golf and basketball frequent travel. Then there were his appearances at charity events.
Under the terms of Monday's ruling, Nantz will give up the couple's Westport home, as well as a separate condominium in Westport. He will keep their home in Houston, Texas and a luxury condo in Park City, Utah.
The couple has been awarded joint custody of their daughter Caroline, 15, but Nantz will pay the teen's college tuition until she turns 23.
Lorraine Nantz was looking for more than $1.5 million in yearly alimony and child support.
Court documents cited Jim Nantz's $3.2 million salary from CBS and other assets, including millions in other income, shared investment accounts, real estate and other property.
Nantz's attorney, Gaetano Ferro of New Canaan, told the Associated Press Tuesday that the famed sportscaster only wants what's best for his daughter and will not fight the terms of the divorce decree.
"He always wanted a peaceful resolution of an unfortunate situation," Ferro said. "He never wanted a trial, never wanted it to come out this way, never wanted a public spectacle. He wants to put it behind him."
Cynthia George, Lorrie Nantz's Greenwich-based attorney, said she and her client had no comment except that they were pleased with the decision.