In this study, the effects of recycled glass (RG) and recycled concrete (RC) fine aggregates on the drying-shrinkage, carbonation, high temperature and abrasion resistance of mortar mixtures were investigated comparatively. In addition, durability performance of the mortar mixtures was investigated through micro-structural analysis. For this purpose, 9 different mortar mixtures were prepared by replacing 25, 50, 75 and 100 wt.% of crushed-limestone fine aggregate with recycled glass and recycled concrete aggregates. Except for the abrasion resistance, the RG mixtures showed better durability performance than the control mixture. However, the RC mixtures containing more than 50% recycled aggregate showed lower performance than the control mixture.