Chronic inflammation is supposed to be an important mediator of cardiometabolic dysfunctions seen in type 2 diabetes. In this mini-review, we collected evidence (PubMed) from randomized controlled trials (through March 2016) evaluating the effect of anti-inflammatory drugs on indices of glycemic control and/or cardiovascular events in people with type 2 diabetes. Within the last 25 years, many anti-inflammatory drugs have been tested in type 2 diabetes, including hydroxychloroquine, anti-tumor necrosis factor therapies (etanercept and infliximab), salsalate, interleukin-1 antagonists (anakinra, canakinumab, gevokizumab, LY2189102), and CC-R2 antagonists. Despite being promising, the observed effects on HbA1c or glucose control remain rather modest in most clinical trials, especially with the new drugs. There are many trials underway with anti-inflammatory agents to see whether patients with cardiovascular diseases and/or type 2 diabetes may have clinical benefit from marked reductions in circulating inflammatory markers. Until now, a large trial with losmapimod (a p38 inhibitor) among patients with acute myocardial infarction, including one/third of diabetic patients, showed no reduction in the risk of major ischemic cardiovascular events. Further evidence is warranted in support of the concept that targeting inflammation pathways may ameliorate glycemic control and also reduce cardiovascular complications in type 2 diabetes.