Members of the archaeal Miscellaneous Crenarchaeotic Group (MCG) are among the most successful microorganisms on the planet. During its evolutionary diversification, this very diverse group has managed to cross the saline-freshwater boundary, one of the most important evolutionary barriers structuring microbial communities. However, the current understanding on the ecological significance of MCG in freshwater habitats is scarce and the evolutionary relationships between freshwater and saline MCG remains poorly known. Here, we carried out molecular phylogenies using publicly available 16S rRNA gene sequences from various geographic locations to investigate the distribution of MCG in freshwater and saline sediments and to evaluate the implications of saline-freshwater transitions during the diversification events. Our approach provided a robust ecological framework in which MCG archaea appeared as a core generalist group in the sediment realm. However, the analysis of the complex intragroup phylogeny of the 21 subgroups currently forming the MCG lineage revealed that distinct evolutionary MCG subgroups have arisen in marine and freshwater sediments suggesting the occurrence of adaptive evolution specific to each habitat. The ancestral state reconstruction analysis indicated that this segregation was mainly due to the occurrence of a few saline-freshwater transition events during the MCG diversification. In addition, a network analysis showed that both saline and freshwater MCG recurrently co-occur with archaea of the class Thermoplasmata in sediment ecosystems, suggesting a potentially relevant trophic connection between the two clades.