Exercise limitation is a cardinal manifestation of many cardiovascular diseases (CVD) and is associated with poor prognosis. It is increasingly well understood that exercise-based cardiac rehabilitation (CR) is an intervention that portends favorable clinical outcomes, including improvements in exercise capacity. The etiology of exercise limitation in CVD is multifactorial but is typically governed by terminal sensations of pain, fatigue, and/or breathlessness. A known but perhaps underestimated complication of CVD that contributes to breathlessness and exercise intolerance in such patients is inspiratory muscle dysfunction. For example, inspiratory muscle dysfunction, which encompasses a loss in muscle mass and/or pressure generating capacity, occurs in up to ~40% of patients with chronic heart failure and is associated with breathlessness, exertional intolerance, and worse survival in this patient population. In this review, we define inspiratory muscle weakness, detail its prevalence in a range of CVDs, and discuss how inspiratory weakness impacts physiological function and clinical outcomes in patients with CVD often referred to CR. We also evaluate the available evidence addressing the effects of exercise-based CR with and without concurrent specific inspiratory muscle training (IMT) on inspiratory muscle function, general physiological function, and clinical outcomes in patients with CVD. Finally, we consider whether the assessment of global respiratory muscle function should become standard as part of the patient intake assessment for phase II CR programs, giving practical guidance on the implementation of such measures as well as IMT as part of phase II CR.