John Bieniewicz, 44, was struck on Sunday during the game in a park.
He was unconscious on the ground in the park when authorities arrived and died in hospital on Tuesday.
Baseel Abdul-Amir Saad, 36, has been charged with assault with intent to do great bodily harm.
But authorities say the charges could be amended following further investigation.
Bieniewicz was an experienced referee who worked at all levels of competition, and a husband and father of two sons, according to media reports and a memorial page set up in his memory.
"I speak for all his friends when I say we are devastated. Crushed. Just a senseless way for a great guy to go out," Bieniewicz's friend Jim Acho told the Associated Press news agency.
Witnesses at the game in Livonia reported seeing Bieniewicz stop play to eject Mr Saad, who had complained about a call and was issued a second caution.
Player Scott Herkes told the Detroit Free Press Bieniewicz was looking down and did not see the punch coming.
"The ref did nothing to provoke this attack," Mr Herkes said. "I have never in my life seen something like this."
Mr Saad reportedly left the field after the incident, and several players got the license plate number of his vehicle as he left.
His lawyer Brian Berry told local media his client was co-operating and had voluntarily turned himself in to police.
"Based on certain witness statements that have not yet been published, it is believed that the facts of this case have been mischaracterised," Mr Berry wrote in an email to the Detroit Free Press.
"As tragic as this event is, we must keep open minds and listen and wait for all the facts of this case to unfold."
It is the second such fatal case in as many years.
In April 2013, a teenaged player punched referee Ricardo Portillo during a football game in Utah.
The father of three died after a week in a coma. The teenager subsequently pleaded guilty to homicide.

After going down to 12 men, following Ben Flower's red card, Wigan scored 21 unanswered points to triumph.
The Warriors have lost the past two Super League deciders at Old Trafford.
"We will take a lot of confidence coming into the back end of the year when confidence is important going into big games," Smith said.
Victory when the Catalans Dragons visit the DW Stadium next week would guarantee Wigan a home semi-final, while their hopes of clinching the League Leaders' Shield are slim as Warrington travel to second-placed Hull FC.
Warrington only need a draw to win the first piece of Super League silverware this season.
"We are looking just to win the game next week. Whatever comes of it, being first or second, gets us a home semi and that is what we want," Smith told BBC Radio Manchester.
"We want to get to Old Trafford and want to win. We've had a disappointing couple of years, and it is all about progressing now and putting in a performance next week."
If Wigan do reach the final for a fourth successive season, they may be without Flower after his elbow on Declan Patton saw him sent off with 23 minutes remaining on Friday.
It was the prop's first dismissal since receiving an early red card in Wigan's Grand Final defeat by St Helens in 2014.
A man down and with the League Leaders' Shield being made ready for presentation to Wolves, the visitors produced a remarkable turnaround from 28-14 down in the second half.
Josh Charnley touched town twice and Lewis Tierney completed a brace of his own before Smith edged Wigan ahead with a drop goal. Anthony Gelling's late try put the result beyond doubt.
"As soon as we got the first try when Benny got sent off I think the belief was there to go on and do something special," Smith said.
"When you come to stadiums like this and get results like that, it gives you a massive lift."
A football referee in the US state of Michigan has died after being punched in the head during an altercation with a player he was ejecting from a match, according to police and witnesses.
[NEXT_CONCEPT]
Wigan have the confidence to go on and win the Super League Grand Final after overcoming leaders Warrington on Friday, says half-back Matty Smith.