Contamination of drinking water is an important health risk factor due to the attendant toxic effect linked to it. We therefore assessed the quality of water samples in each of the study areas of Gedyo Zone where water quality suspected with some problems by Zonal water quality administrative. In this study, heavy metals, fluoride, phosphorus light metals and physicochemical parameters of the water samples including pH, turbidity, total dissolved solids (TDS) were determined. The pH ranged from 6.77 to 8.19; while turbidity ranged from 3.78 to 40.2 NFU for borehole water in the study areas. On the other hand, TDS was in the order of 1.83 to 62. The levels of fluoride and phosphorus are in the acceptable range according to WHO permissive limit. Mean concentration of heavy metals for the water samples in all of the study areas were found to be in WHO acceptable range. However, Iron (Fe) level in Dilla College of Teacher`s Education (DCTE) exceeded WHO permissive level. Findings from this study show that water sources in the DCTE has high amount of iron and its turbidity is very high compared to other site in the study areas, which needs further treatment before dispatching for the public use.