Mastitis frequently affects women of childbearing age. Of all the pathological breast conditions requiring specific management, autoimmune mastitis is in the third position after infection and breast cancer. The aim of this literature review was to make a comprehensive description of autoimmune diseases targeting the mammary gland. Four main histological patterns of autoimmune mastitis are described: (i) lymphocytic infiltrates; (ii) ductal ectasia; (iii) granulomatous mastitis; and (iv) vasculitis. Our literature search found that all types of autoimmune disease may target the mammary gland: organ-specific diseases (diabetes, thyroiditis); connective tissue diseases (such as systemic erythematosus lupus or Sjögren’s syndrome); vasculitides (granulomatosis with polyangiitis, eosinophilic granulomatosis with polyangiitis, giant cell arteritis, polyarteritis nodosa, Behçet’s disease); granulomatous diseases (sarcoidosis, Crohn’s disease); and IgG4-related disease. Cases of breast-specific autoimmune diseases have also been reported, including idiopathic granulomatous mastitis. These breast-limited inflammatory diseases are sometimes the first symptom of a systemic autoimmune disease. Although autoimmune mastitis is rare, it is probably underdiagnosed or misdiagnosed. Early diagnosis may allow us to detect systemic diseases at an earlier stage, which could help to initiate a prompt, appropriate therapeutic strategy. In case of suspected autoimmune mastitis, we hereby propose a diagnostic pathway and discuss the potential pathophysiological pathways leading to autoimmune breast damage.