Size up unless you want a skin-tight fit!  I'm 5'3 & 118 lbs, normally wearing an XS or S and bought this in a medium and the fit in loose but not baggy.  Worked great to keep my cool on a hot hike (especially after soaking it first).