More than 350 Roma people had lived in the camp on La Petite Ceinture since mid-2015. Activists said many left early ahead of the police action.
The site belongs to the national rail authority SNCF.
France has one of Europe's toughest policies towards Roma. Most live in camps that are regularly demolished and every year thousands are deported.
Amnesty International urged city authorities to find a lasting housing solution for those evicted in Paris - saying they would become homeless in mid-winter.
Hundreds of thousands of Roma - mostly from Romania and Bulgaria - have moved to western Europe since the 1990s.
The Council of Europe, the region's main human rights body, warned that evictions were "counter-productive" because they disrupted education and healthcare for Roma children.
Council of Europe Secretary General Thorbjorn Jagland said it was crucial for French authorities to provide "adequate, alternative accommodation" for those evicted, "particularly as they have decided to take this action during winter".
France's unwanted Roma

Co-op Bank was forced to put itself on the market in February after it was unable to reach a strong enough footing to satisfy Bank of England regulations.
But in June, it said it was in "advanced discussions" with a group of existing investors on recapitalisation.
Now the bank says the plan has been "substantially agreed".
The Co-op Bank, in which the Co-operative Group still has a 20% stake, was rescued from the brink of collapse by a group of hedge funds in 2013.
In a statement, the bank also said talks were continuing over the separation of its pension fund from the Co-operative Group's scheme.
Under the current arrangement, the bank must carry a share of the Co-op Group's £8bn pension liabilities, something which is proving unattractive to potential investors.
Earlier this year, it reported its fifth annual loss in a row, although the £477m deficit for 2016 was an improvement on the £610m loss recorded in 2015.
When it offered itself for sale, the Co-op Bank blamed low interest rates and the higher-than-expected cost of its turnaround plan for its failure to meet the Bank's Prudential Regulation Authority rules.
The Co-op Bank has four million customers and is well known for its ethical standpoint, which its board had said made it "a strong franchise with significant potential" to prospective buyers.

It is the third time Vitalmiro Bastos Moura has been tried for Dorothy Stang's 2005 death after previous convictions were overturned.
Ms Stang, 73, campaigned for 30 years to save rainforest from the interests of wealthy landlords.
She had tried to block Moura's attempts to seize land and was shot six times.
Moura, who was convicted in 2007 and 2010 in verdicts that were subsequently overturned, was sentenced to 30 years in prison.
In the latest trial, the judge said Moura had acted in a cold-blooded and cowardly manner.
Prosecutors earlier said Moura and another rancher had hired gunmen to kill Ms Stang. Moura's lawyers argued there wasn't enough evidence linking him to the crime.
The death of Ms Stang in the northern state of Para became a symbol of the violent conflict for natural resources in Brazil's Amazon region.
In the past 30 years, more than 1,000 people have been killed in land disputes in Brazil, with some two-thirds of the murders happening in Para.
Ahead of the latest verdict, Ms Stang's sister, Barbara Richardson, said the repeated trials had been upsetting but had helped maintain a spotlight on the issues.
"That keeps the injustice of the system before the people's eyes," she told AP. "Dorothy is ever prominent. The people understand what happened to her and what this means."

16 January 2017 Last updated at 17:18 GMT
Mr Murphy said the party had been "stretched to the limits" by their former partners in government, the DUP. (Democratic Unionist Party).
Police have cleared hundreds of Roma people from a slum-like camp built on a disused rail line in north Paris.
[NEXT_CONCEPT]
The Co-operative Bank says it is no longer up for sale, pending an announcement on fund-raising proposals aimed at safeguarding its future.
[NEXT_CONCEPT]
A Brazilian court has convicted a rancher for ordering the murder of an American nun over a land dispute - a case that caused international outrage.
[NEXT_CONCEPT]
Sinn Féin's Conor Murphy says it's time for an election as the deadline passes for Secretary of State James Brokenshire to call one, after the party refused to re-nominate a deputy first minister.