Experts reassembled pieces of tiles found amid tons of earth from the site known to Jews as the Temple Mount and to Muslims as Haram al-Sharif.
They say the tiles date from the period of the Second Temple, during the time of King Herod about 2,000 years ago.
The temple was destroyed by the Romans in 70 AD during a Jewish rebellion.
Some 600 segments of coloured stone floor have been found since archaeologists began examining the debris from the hilltop site in 2004.
The plateau where the temples stood is the most sacred site in Judaism. It is joined by the Western Wall, venerated by Jews as part of the original supporting wall of the temple compound.
Haram al-Sharif (Noble Sanctuary) is also the place where Muslims believe the Prophet Muhammad ascended to Heaven, and is the third holiest site in Islam.
The archaeologists say the tiles probably came from porticos in the temple's courtyards.
Piecing the fragments together "enables us to get an idea of the Temple's incredible splendour", said Dr Gabriel Barkay of the Temple Mount Sifting Project.
Experts say they managed to assemble seven potential designs of how the flooring could have looked like. The type of flooring is known as opus sectile, Latin for "cut work", and "considered to be far more prestigious than mosaic tiles floors", according to Frankie Snyder, from the project's team.
"The tile segments were perfectly inlaid such that one could not even insert a sharp blade between them," she said.
The Temple Mount Sifting Project was established by Israeli archaeologists in 2004 to examine debris dumped by Islamic authorities following expansion work at an underground mosque on the compound.
The project attracts thousands of visitors each year who participate in finger-tip searches of the earth and has so far turned up hundreds of ancient relics, including coins, animal bones and pieces of pottery.

The White House and state department said plans for up to 300 new homes and an industrial zone were diminishing prospects for a two-state solution to the Israeli-Palestinian conflict.
Israel insisted fewer than 100 homes had been approved.
Its foreign ministry said the new homes would be built within the area of an existing settlement.
Palestine Liberation Organisation (PLO) secretary general Saeb Erekat said while Palestinians welcomed Washington's criticism, they expected it "to take real action".
"After almost 50 years of systematic Israeli colonisation and belligerent military occupation of the State of Palestine, the US must implement the necessary tools to end Israeli settlements, including through the UN Security Council, end funding to Israel, and stop funding settlements through US-based organisations fuelling violence and discrimination against Palestinians," he said.
About 570,000 Israelis live in more than 100 settlements built since Israel's 1967 occupation of the West Bank and East Jerusalem. The settlements are considered illegal under international law, though Israel disputes this.
In July, world powers warned of "perpetual occupation and conflict" between Israelis and Palestinians.
"The actions of the Israeli government in announcing this settlement undermine the pursuit of peace," said White House spokesman Josh Earnest.
State department spokesman Mark Toner said the new settlement would be "another step towards cementing a reality of perpetual occupation" that would "further call into question Israel's commitment to achieving a negotiated peace".
It was "deeply troubling", Mr Toner said, because Israel had announced it so soon after the US agreed last month to a 10-year $38bn (Â£30bn) military aid package for the country.
However, Israel's foreign ministry said the new units did not constitute a "new settlement".
"This housing will be built on state land in the existing settlement of Shilo and will not change its municipal boundary or geographic footprint," a statement said.
"The real obstacle to peace is not the settlements - a final-status issue that can and must be resolved in negotiations between the parties - but the persistent Palestinian rejection of a Jewish state in any boundaries," it added.
Palestinians want an independent state in the West Bank and Gaza with East Jerusalem as its capital, and say settlements make this impossible.

12 June 2017 Last updated at 15:24 BST
He first arrived on the men's tennis Tour when he was 15-years-old and has been setting records since then.
Leah has taken a look at Nadal's amazing records in numbers.
Check out Newsround's guide to Wimbledon, which starts in just a few weeks.
Archaeologists in Jerusalem say they have for the first time reconstructed likely designs of a Biblical Jewish temple floor using original fragments.
[NEXT_CONCEPT]
The US has "strongly condemned" Israel for approving plans for new settlement construction in the occupied West Bank.
[NEXT_CONCEPT]
Rafael Nadal has become the first tennis player to win a record 10 French Open titles.