The Coronation Street actor is accused of using racist language and being sexist.
The show's bosses have already formally warned him about "offensive" language during chats with R&B singer Alexander O'Neal.
He was also called out over "unacceptable" sexually suggestive comments directed at female housemates.
The 71-year-old's son, Roger, apparently posted an apology on behalf of his son on Facebook.
He said he would like to apologise to anyone "offended by my dad's behaviour".
Separately, Ofcom has received two complaints about the use of an offensive word by Katie Hopkins and four complaints over the incident in which former Baywatch star Jeremy Jackson pulled open Chloe Goodman's dressing gown.
The actor has since been chucked out of the house, also for "wholly unacceptable" behaviour.
The broadcasting watchdog will assess the complaints before deciding whether to investigate.
Channel 5 has not said if it has received new complaints but said it will be making an announcement regarding Ken Morley.
Follow @BBCNewsbeat on Twitter, BBCNewsbeat on Instagram and Radio1Newsbeat on YouTube.

Media playback is not supported on this device
Glenavon had taken the lead on 34 minutes when Kyle Neill's corner went straight in at the far post.
Kirk Millar and Andrew Waterworth scored two to put Linfield 3-1 up with Kris Lindsay pulling one back.
Glenavon pulled level when Andy Kilmartin's shot was deflected by team-mate Eoin Bradley but Mark Haughey got the winner with a deflected header.
Linfield's Kirk Millar: "We made it hard for ourselves in the end but Mark Haughey dug us out with a header for the winner.
"We should have had the game won before that and we made it harder than it should have been.
"It was about time I hit the net. I had to make the run because you know a player of Niall Quinn's quality will deliver the ball.
"Andrew Waterworth is just a natural goalscorer and he gave us the edge in the first half."

La Liga and European champions Madrid won 2-0 on Wednesday night to complete a 5-1 aggregate victory.
Pique, 30, who has been at Barca for nine years, said: "We are not in the best moment, as a team or a club.
"This a long process and there is room for improvement, We must stay as close as possible and keep moving forwards."
Real were without Cristiano Ronaldo, who is serving a five-match suspension after being sent off in the first leg, and left Gareth Bale and Isco on the bench.
Barcelona, who are lacking in attacking options since the world record transfer of Neymar to Paris St-Germain, scored their only goal over the two legs from the penalty spot.
General manager at the Nou Camp, Pep Segura, claims the signings of Philippe Coutinho and Ousmane Dembele are "close".
Liverpool are adamant that Brazilian playmaker Coutinho, who has submitted a transfer request, will not be sold in this transfer window but Segura has told Spanish television: "We are discussing their deals but do not know when it will be done."
Borussia Dortmund suspended Dembele after the 20-year-old forward failed to turn up for training.
"We know we have to strengthen this team and that is what we are doing," Segura added. "We have to help the team."
Ofcom tells Newsbeat it has received 233 complaints about Ken Morley's behaviour on Celebrity Big Brother.
[NEXT_CONCEPT]
Linfield maintained their four-point lead at the top of Irish Premiership by beating Glenavon 4-3 at Windsor Park.
[NEXT_CONCEPT]
Barcelona defender Gerard Pique says he felt "inferior" to Real Madrid for the first time after being thrashed by their rivals in the Spanish Super Cup.