Background

Patients scheduled for major elective noncardiac surgery frequently undergo preoperative medical consultations. However, the factors that determine whether individuals undergo consultation and the extent of interhospital variation remain unclear.

Methods

The authors used population-based administrative databases to conduct a cohort study of patients, aged 40 yr or older, who underwent major elective noncardiac surgery in Ontario, Canada, between April 2004 and February 2009. Multilevel logistic regression models were used to identify patient- and hospital-level predictors of consultation.

Results

Within the cohort of 204,819 patients who underwent surgery at 79 hospitals, 38% (n = 77,965) underwent preoperative medical consultation. Although patient- and surgery-level factors did predict consultation use, they explained only 5.9% of variation in consultation rates. Differences in rates across hospitals were large (range, 10-897 per 1,000 procedures), were not explained by surgical procedure volume or hospital teaching status, and persisted after adjustment for patient- and surgery-level factors. The median odds of undergoing consultation were 3.51 times higher if the same patient had surgery at one randomly selected hospital as opposed to another.

Conclusions

One-third of surgical patients undergo preoperative medical consultation. Although patient- and surgery-level factors are weak predictors of consultation use, the individual hospital is the major determinant of whether patients undergo consultation. Additional research is needed to better understand the basis for this substantial interhospital variation and to determine which patients benefit most from preoperative consultation.

  • Preoperative consultation by internal medicine specialists occurs in 10–40% of patients, but whether this can be explained solely by surgical or patient factors is not known

  • More than one third of more than 200,000 patients in Ontario undergoing surgery received preoperative medical consultation

  • Although patient and surgical factors were weakly associated with medical consultation, there was a large variability among hospitals, suggesting local factors play a large role in this practice

PREOPERATIVE consultations by internal medicine specialists (hereafter referred to as “preoperative medical consultations”) play an important role in the care of patients undergoing major surgery. They may be especially helpful for the many surgical patients who have medical comorbidities. For example, approximately 20% have diabetes mellitus,1whereas 14% have chronic obstructive pulmonary disease.2For such patients, the preoperative consultation is an opportunity to better document comorbid disease, undertake risk stratification, optimize factors associated with preexisting medical conditions, initiate interventions intended to decrease perioperative risk, and defer or cancel surgery.

Despite these presumed benefits for intermediate-to-high–risk patients, the factors that determine whether an individual does or does not undergo preoperative medical consultation remain unclear. Current data addressing this issue are limited. Previous studies generally were single-center in design and reported consultation rates ranging from 10% to 40%,3,,8thus suggesting important practice variation between hospitals. Similarly, consultation rates may differ substantially across surgical services, even after adjustment for patients' medical comorbidities.4In addition, previous research has suggested that medical comorbidities are not the most important determinant of preoperative consultation. For example, more than half of patients who underwent consultation in two previous North American studies were considered low-risk patients.9,10 

Given the overall paucity of relevant data and the limited generalizability of previous single-center studies, we conducted a population-based cohort study in Ontario, Canada. Our objectives were to (1) identify the patient- and hospital-level determinants of preoperative medical consultation; (2) describe the extent of any interhospital variation; and (3) describe the association of hospital-specific consultation rates with related processes of care and outcomes.

After research ethics approval was received from Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada, we used population-based administrative healthcare databases to undertake a retrospective cohort study in Ontario, Canada. These databases were the Discharge Abstract Database (DAD) of the Canadian Institute for Health Information (hospital admissions), the Ontario Health Insurance Plan (OHIP) database (physician service claims), the Registered Persons Database (demographics and vital statistics), the Institute for Clinical Evaluative Sciences Physician Database (physicians' specialties), the Ontario Drug Benefit database (prescription medications for individuals 65 yr and older), and the Canadian census. Although the databases lack physiologic and laboratory measures, such as blood pressure or hemoglobin, they have been validated for many outcomes, exposures, and comorbidities.11,,15Unique anonymous identifiers were used to link healthcare information on the same individuals across these data sets. During the study period, Ontario was Canada's most populous province, with more than 13 million residents, all of whom have universal access to physician and hospital services through a publicly funded healthcare program.

Overview of Preoperative Processes of Care in Ontario

Any patient scheduled to undergo elective surgery at an Ontario hospital must undergo a documented preoperative history and physical, which is typically performed by the patient's primary care physician or surgeon. In Canada, adult primary care is almost exclusively provided by family physicians, whereas general internists and specialists principally perform a consultative role.16,17As opposed to the mandatory preoperative history and physical, referrals for preoperative consultations by internal medicine specialists are left to the discretion of the responsible surgeon or anesthesiologist. The responsible surgeon may also refer a patient for preoperative anesthesia consultation, which is distinct  from the routine in-hospital evaluation by the responsible anesthesiologist on the day before or the morning of surgery.18Instead, the patient undergoes a formal consultation with an anesthesiologist several days to weeks before surgery, typically in an outpatient preassessment clinic. These preoperative anesthesia consultations are identified by distinct physician billing codes in the OHIP database.

Assembly of Study Cohort

We retrospectively identified all Ontario residents, aged 40 yr or older, who underwent the following elective noncardiac surgeries between April 1, 2004 and February 28, 2009: abdominal aortic aneurysm repair, carotid endarterectomy, peripheral vascular bypass, total hip replacement, total knee replacement, large bowel surgery, liver resection, Whipple procedure, pneumonectomy, pulmonary lobectomy, gastrectomy, esophagectomy, nephrectomy, or cystectomy. These procedures were selected because they are associated with intermediate to high risk,19are applicable to either sex, and can be identified using the DAD.20,,22Procedural information in the DAD is very accurate.15To reduce variability caused by low procedure volumes, we excluded data from hospitals that did not perform at least 10 eligible procedures during each  year of the study period (i.e ., 50 or more procedures during the study period).

Because there is no specific OHIP fee code to identify medical consultations for preoperative evaluation, as opposed to nonoperative indications, we used a validated claims-based definition: an OHIP claim for a consultation by a cardiologist, general internist, endocrinologist, geriatrician, or nephrologist within 4 months (120 days) before the index surgery. Although this 4-month interval may not be typical of some other jurisdictions, it is consistent with typical preoperative wait times in Ontario. Specifically, once patients have been deemed to require surgery, the time required for 90% of them to undergo their scheduled procedure is 58 days for cancer surgery, 104 days for vascular surgery, and 192 days for orthopedic surgery.#In addition, compared with reabstraction of primary medical records in a multicenter validation study, this algorithm had a sensitivity of 90%, specificity of 92%, positive predictive value of 93%, and negative predictive value of 90%.23 

Demographic information (age, sex) was obtained from the Registered Persons database. We used validated algorithms to identify patients with diabetes mellitus or hypertension.12,14The OHIP database was used to identify patients who required dialysis before their index surgery. Using the DAD, we used previously described methods to identify other comorbidities based on International Classification of Diseases  codes (ninth or tenth revisions) from hospitalizations within 3 yr before surgery: coronary artery disease, congestive heart failure, atrial fibrillation, cerebrovascular disease, peripheral vascular disease, pulmonary disease, chronic renal insufficiency, previous venous thromboembolism, liver disease, peptic ulcer disease, rheumatologic disease, hemiplegia or paraplegia, malignancy, and dementia.24,,26The OHIP database was used to identify outpatient anesthesiologist consultations within 60 days before surgery,18outpatient specialized testing (noninvasive cardiac stress tests, echocardiograms, pulmonary function tests),27,28epidural anesthesia or analgesia (hereafter referred to as “anesthesia”),1and intraoperative invasive monitoring. The Ontario Drug Benefit database was used to identify outpatient prescriptions for related medications (β-blockers, statins) in individuals 65 yr and older. Patients' socioeconomic status was estimated based on their neighborhood median income in the Canadian census, and their residence (rural vs.  urban) was determined using Statistics Canada definitions.29In addition, we ascertained all-cause mortality at 30 days after surgery, which is accurately captured by the DAD (in-hospital events) and Registered Persons Database (out-of-hospital events).30 

Statistical Analysis

We initially used standardized differences to compare the characteristics of patients who did or did not undergo preoperative medical consultation.31A multilevel logistic regression model was then used to determine the adjusted association of patient- (demographics, neighborhood income quintile, rural residence, comorbid disease, surgery) and hospital-level (teaching status, surgical procedure volume) factors with preoperative medical consultation, while accounting for clustering of patients within individual hospitals. This multilevel model, also termed a “random intercept model,” is a standard multivariable logistic regression model that includes an extra term to characterize random differences in consultation rates between hospitals. We used methods previously described to categorize hospitals into quartiles32based on the total volume of included procedures. The final model included all patient- and hospital-level factors, as well as any clinically sensible interaction terms that had P  values <0.20 and improved model fit. For the final model, discrimination was measured using the c index, calibration was evaluated using observed-versus -predicted plots, and proportion of explained variation was measured by the squared Pearson correlation between observed and predicted outcomes.33We used the variance inflation factor to assess for any multicollinearity within the model.

Given the interpretational difficulties of the intraclass correlation coefficient with multilevel modeling of binary outcomes, we used the median odds ratio to measure variability between hospitals.34The median odds ratio is the median value obtained comparing the adjusted odds of undergoing consultation if the same individual underwent surgery at two different randomly selected hospitals. Because it always involves comparisons of higher-ranked versus  lower-ranked hospitals , the median odds ratio has a value greater than or equal to one. It characterizes heterogeneity across hospitals, is adjusted for patient-level covariates, and may be directly compared against odds ratios of patient-level characteristics.34For example, a value of 1.50 suggests 50% higher odds of receiving preoperative medical consultation if the same patient had surgery at one randomly selected hospital as opposed to another.

Several analytical approaches were used to further evaluate interhospital variation in preoperative medical consultation. First, we measured the overall interhospital variation in rates of consultation. Second, descriptive statistics were used to compare the patient-level characteristics, hospital-level characteristics, and perioperative processes of care at hospitals with differing rates of preoperative medical consultation. Hospitals initially were ranked based on their unadjusted rates of preoperative medical consultation. The ranked hospitals were then categorized into quartiles with approximately equal numbers of patients. Finally, we used a Cox proportional hazards model to determine the association of hospital-specific consultation rates (categorized into quartiles) with 30-day postoperative mortality. This model adjusted for patient-level factors (demographics, neighborhood income quintile, rural residence, comorbid disease, surgery), hospital characteristics (teaching status, procedure volume quartile), and perioperative processes of care that may vary across hospitals (anesthesia consultation, epidural anesthesia, invasive monitoring). For these analyses, hospital-specific rates of anesthesia consultation, epidural anesthesia, and invasive monitoring were categorized into quartiles with approximately equal patient numbers. We used appropriate statistical methods to account for clustering of patients within hospitals35and verified the proportional hazards assumption by visual inspection of estimated logarithm-minus-logarithm survival curves.

All analyses were performed using SAS version 9.2 (SAS Institute, Cary, NC), and a two-tailed P  value <0.05 was used to define statistical significance.

The study cohort consisted of individuals who underwent surgery at 79 hospitals. Within this cohort, 38.1% (n = 77,965) underwent preoperative medical consultation. Patients who underwent consultation typically were older individuals who had surgery at teaching or very high-volume hospitals and had increased burdens of most comorbid diseases (table 1).

The adjusted associations of patient-level factors with consultation are presented as odds ratios from a multilevel logistic regression model in table 1of Supplemental Digital Content 1, https://links.lww.com/ALN/A791. Consultation was associated closely with increased age and comorbid disease. In addition, considerable variation existed across surgical procedures and hospitals with regard to consultation use. The median odds ratio across institutions was 3.51, meaning that the odds of receiving preoperative medical consultation was 3.5 times greater if the same patient had surgery at one randomly selected hospital as opposed to another. However, this interhospital variation was not explained by either hospital teaching status (P = 0.81) or procedure volume (P = 0.22). The regression model had good discrimination (c index 0.82), good calibration (based on an observed-vs. -predicted plot), and explained 30.5% of the observed variation in consultation rates. By comparison, a logistic regression model that did not account for any hospital-level variation and included only the patient-level factors listed in table 1of Supplemental Digital Content 1, https://links.lww.com/ALN/A791, showed poor discrimination (c index 0.64) and explained only 5.9% of the observed variation in consultation rates.

When the 79 hospitals were ranked with respect to rates of medical consultation, there was considerable interinstitutional variation (fig. 1). The median hospital-specific consultation rate was 266 per 1,000 procedures (range, 10–897). Although there was also considerable interinstitutional variation in preoperative anesthesia consultation (median 542 per 1,000 procedures, range 6–967), there was no significant correlation (see fig. 1of Supplemental Digital Content 2, https://links.lww.com/ALN/A792) between rates of anesthesia and medical consultation rates within the same institution (Pearson R, 0.13; P = 0.13). Interhospital variation was also evident within subgroups defined by surgical procedure, such as major orthopedic (see fig. 2 of Supplemental Digital Content 2, https://links.lww.com/ALN/A792) or large bowel resection (see fig. 3 of Supplemental Digital Content 2, https://links.lww.com/ALN/A792) procedures. There was a moderate positive correlation of medical consultation rates between orthopedic and large bowel resection procedures within the same institution (Pearson R, 0.41; P = 0.003).

When hospitals were ranked into quartiles based on unadjusted consultation rates, the mean consultation rate ranged from 120 per 1,000 procedures in the lowest quartile to 702 per 1,000 procedures in the highest quartile. This large gradient in consultation rates was accompanied by some differences in patient characteristics, hospital characteristics, preoperative testing, perioperative processes of care, and new preoperative medication prescriptions (tables 2and 3). After adjustment for patient and hospital characteristics (see table 2of Supplemental Digital Content 1, https://links.lww.com/ALN/A791, which shows the characteristics of the multivariable regression model used for risk adjustment), the differences in 30-day postoperative mortality across quartiles (table 4) were statistically significant (P < 0.001). Compared with the quartile with the lowest adjusted mortality rate, namely quartile 2 (mean consultation rate, 219 per 1,000 procedures), the adjusted hazard ratio for 30-day mortality was 1.13 (95% CI, 0.95–1.34; P = 0.16) in quartile 1 (consultation rate, 120 per 1,000 procedures), 1.07 (CI, 0.91–1.25; P = 0.42) in quartile 3 (consultation rate, 432 per 1,000 procedures), and 1.33 (CI, 1.14–1.55; P < 0.001) in quartile 4 (consultation rate, 702 per 1,000 procedures).

In this population-based cohort study, preoperative medical consultations for major elective noncardiac surgery were relatively common, having been performed in approximately one third of patients. Referrals for consultation were associated with several patient-level characteristics, including older age, comorbid disease, and type of surgery. However, differences in consultation rates across surgeries did not reflect their inherent operative risks. Even after adjustment for patient-level factors, there remained substantial variation in consultation rates across hospitals, which was not explained by either teaching status or procedure volume.

Implications

Rates of medical consultation demonstrated substantial interhospital variation that was not explained by differences in medical comorbidities, operative risk, hospital teaching status, or surgical procedure volume. Compared with the median odds ratio of 3.51 across hospitals, the highest odds ratio associated with any single patient comorbidity was 1.85 (see table 1of Supplemental Digital Content 1, https://links.lww.com/ALN/A791), namely for coronary artery disease. This degree of interinstitutional variation, which is consistent with the wide range of consultation rates reported by previous single-center studies,3,,8is not completely unexpected. Practice variation is likely highest for any service for which there is little consensus about its appropriateness.36Although there are consensus-based guidelines for managing perioperative cardiac and pulmonary risk,19,37,38they make no clear recommendations regarding which patients require medical consultation before surgery. Consequently, preoperative medical consultation can be considered a service for which there is little consensus and thus would be expected to have a high degree of variation.36 

Although this variation is not surprising, it may have implications for patients and the healthcare system. When performed in patients who are unlikely to benefit from them, these consultations can increase healthcare costs while exposing some individuals to unnecessary, and potentially harmful, tests or interventions.27,28Notably, there is no clear evidence that preoperative medical consultations improve outcomes. Indeed, previous observational studies have suggested that consultations may worsen  outcomes. Specifically, perioperative medical consultations were associated with increased hospital stay and a trend toward increased complications in a single-center American study,3whereas a population-based evaluation of preoperative medication consultations performed in Ontario from 1999 to 2004 showed that consultations were associated with slightly increased postoperative mortality.39The current study also lends some support to these previous findings, as evidenced by the higher rates of postoperative mortality at hospitals with high consultation rates (table 4). However, our comparison of outcomes across hospitals with differing consultation rates should be viewed cautiously, especially because this analysis adjusted for relatively few hospital-specific confounders. Nonetheless, these observational studies, although not proving that preoperative medical consultations cause increased postoperative morbidity and mortality, do cast doubts on the appropriateness of the high consultation rates at many Ontario hospitals.

The basis for the substantial interhospital variation in preoperative medical consultation remains unclear. Differences in individual surgeons' preferences may explain it in some part. However, we did not evaluate the impact of individual surgeons on consultation rates in the current study because of the analytical difficulties of comparing multiple surgeons nested within many different surgical specialties and hospitals. Thus, future studies should evaluate the influence of surgeons on consultation rates within a more homogenous group of surgical procedures (e.g. , major joint replacement). Nonetheless, there is likely an important effect of the individual hospital on consultation rates, as evidenced by the moderate positive correlation between hospital-specific consultation rates for dissimilar surgeries, namely major joint replacement versus  colon resection procedures. It is unlikely that hospital-specific financial incentives to physicians were a major influence on hospital-level variation because physicians at these Ontario hospitals were all compensated in a similar manner through service claims to the publically funded healthcare program. Consequently, the financial incentive to perform more consultations would have been similar across hospitals. In addition, institution-specific preferences for anesthesia consultation were not major influences on whether patients underwent medical consultation because there was little correlation between medical and anesthesia consultation rates. The hospital factors that may explain this substantial practice variation include facilities that aid preoperative consultations (e.g. , dedicated preoperative assessment clinics), policies for the preoperative preparation of surgical patients, or institutional preference for the involvement of internists in perioperative care.

In the absence of previous data clearly defining which individuals most likely benefit from preoperative medical consultation, it is reasonable to assume that consultations should focus on patients who are at increased risk for perioperative complications because of medical and surgical risk factors. On that basis, our current study suggests that the unnecessary use of consultation in low-risk individuals is a real concern. The presence of medical comorbidities, although associated with preoperative consultation, explained only a small proportion of the substantial interhospital variation in consultation rates. In addition, although consultation rates varied across surgical procedures, thereby confirming a previous single-center study,4the variation was not consistent with the inherent operative risks of different procedures. For example, patients undergoing orthopedic surgery were at least as likely to undergo consultation as those undergoing abdominal aortic aneurysm repair, despite the latter being a much higher-risk procedure.40 

Future Directions for Research

Given that preoperative medical consultation was relatively common and its use varied considerably across hospitals, our results highlight several broad areas that warrant additional research. First, more high-quality studies are needed to identify efficacious interventions for reducing perioperative risk. Without such research, consulting internists will have few evidence-based approaches for improving the outcomes of intermediate-to-high–risk surgical patients. Second, the characteristics of patients who are most likely to benefit from preoperative consultation must be better established. Such information will help define “appropriateness” criteria that could guide surgeons' decisions about which patients to refer for preoperative consultation and thereby reduce interinstitutional variation in consultation rates. Third, our analyses should be replicated using data sources from other geographic regions. It would be of interest to know whether such studies identify considerable interinstitutional variation in consultation rates, as well as the same “J-shaped” correlation between consultation rates and mortality.

Finally, more research is required on factors that may explain the substantial interhospital variation in consultation rates. These studies should combine qualitative and quantitative analytic strategies. Specifically, qualitative studies could use structured interviews of surgeons and internists at hospitals with differing consultation rates to identify factors that may explain the interinstitutional variation. In addition, future quantitative studies could enhance the detail of multivariable statistical analyses by incorporating information not available from the data sources in our current study. Potentially useful information could include the presence of dedicated preoperative assessment clinic facilities and the use of medical-surgical comanagement models for postoperative care.41 

Limitations

Several limitations should be considered when interpreting the results of our study. First, although it characterized the predictors of preoperative consultation and its practice variation within Ontario, similar types of studies should be repeated in other settings to determine the reproducibility of our findings. Several aspects of perioperative care in Ontario, such as the average preoperative wait time, the absence of internist involvement in primary care,16,17and the degree of overall consensus regarding the need for preoperative medical consultation, may not be generalizable to other healthcare jurisdictions. For example, in jurisdictions where preoperative consultation is deemed “appropriate” for a higher proportion of surgical patients, there is likely to be a lower degree of interinstitutional practice variation.36Second, as with any area-level analysis,42the observed differences in postoperative mortality based on hospital-specific medical consultation rates do not imply that varying consultation rates were entirely responsible for the differences in perioperative outcomes.

Third, our administrative databases cannot account for patients who had their surgery canceled after being deemed unfit for surgery by the consulting internist. Nonetheless, such cancellations are rare, occurring after approximately 1–2% of preoperative consultations.43,44Finally, these data sources lacked some important relevant information, such as specific hospital characteristics, most postoperative complications,45and measures of disease severity or surgical complexity. For example, unmeasured differences in disease severity, surgical complexity, and availability of preoperative assessment clinic facilities may have explained some of the residual interinstitutional variation in consultation rates. In addition, the availability of information on postoperative complications (e.g. , myocardial infarction) might help further assess whether hospital-specific consultation rates affect clinical outcomes. Specifically, because surgical mortality rates are not always reliable indicators of hospital quality46and the observed 30-day mortality rates in our current study were less than 1%, mortality may not be the ideal outcome measure for assessing the value or harm associated with preoperative medical consultation.

Preoperative medical consultation for major elective noncardiac surgery was relatively common in Ontario, occurring in approximately one third of patients. Referral for medical consultation was associated with increased patient age and comorbid disease. Consultation use also varied across surgeries but in a manner that did not reflect the inherent operative risks of the surgical procedures. Although these patient-level factors (age, comorbid disease, surgery) were associated with medical consultation, the individual hospital site, independent of its teaching status or surgical procedure volume, was the major determinant of whether patients underwent consultation before surgery. Additional research is needed to better determine the basis for this substantial interhospital variation and which patients would benefit most from preoperative consultation.

1.
Wijeysundera DN, Beattie WS, Austin PC, Hux JE, Laupacis A: Epidural anaesthesia and survival after intermediate-to-high risk non-cardiac surgery: A population-based cohort study. Lancet 2008; 372:562–9
2.
Arozullah AM, Khuri SF, Henderson WG, Daley J, Participants in the National Veterans Affairs Surgical Quality Improvement Program: Development and validation of a multifactorial risk index for predicting postoperative pneumonia after major noncardiac surgery. Ann Intern Med 2001; 135:847–57
3.
Auerbach AD, Rasic MA, Sehgal N, Ide B, Stone B, Maselli J: Opportunity missed: Medical consultation, resource use, and quality of care of patients undergoing major surgery. Arch Intern Med 2007; 167:2338–44
4.
Bugar JM, Ghali WA, Lemaire JB, Quan H, Canadian Perioperative Research Network: Utilization of a preoperative assessment clinic in a tertiary care centre. Clin Invest Med 2002; 25:11–8
5.
Katz RI, Cimino L, Vitkun SA: Preoperative medical consultations: Impact on perioperative management and surgical outcome. Can J Anesth 2005; 52:697–702
6.
Maggio C, Bonzano A, Conte E, Libertucci D, Panarelli M, Bobbio M, Pintor PP: Preoperative evaluation in non-cardiac surgery: Cardiac risk assessment. Qual Assur Health Care 1992; 4:217–24
7.
Parker BM, Tetzlaff JE, Litaker DL, Maurer WG: Redefining the preoperative evaluation process and the role of the anesthesiologist. J Clin Anesth 2000; 12:350–6
8.
van Klei WA, Moons KG, Rutten CL, Schuurhuis A, Knape JT, Kalkman CJ, Grobbee DE: The effect of outpatient preoperative evaluation of hospital inpatients on cancellation of surgery and length of hospital stay. Anesth Analg 2002; 94:644–9
9.
Devereaux PJ, Ghali WA, Gibson NE, Skjodt NM, Ford DC, Quan H, Guyatt GH: Physician estimates of perioperative cardiac risk in patients undergoing noncardiac surgery. Arch Intern Med 1999; 159:713–7
10.
Kleinman B, Czinn E, Shah K, Sobotka PA, Rao TK: The value to the anesthesia-surgical care team of the preoperative cardiac consultation. J Cardiothorac Anesth 1989; 3:682–7
11.
Austin PC, Daly PA, Tu JV: A multicenter study of the coding accuracy of hospital discharge administrative data for patients admitted to cardiac care units in Ontario. Am Heart J 2002; 144:290–6
12.
Hux JE, Ivis F, Flintoft V, Bica A: Diabetes in Ontario: Determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care 2002; 25:512–6
13.
Juurlink D, Preya C, Croxford R, Chong A, Austin P, Tu J, Laupacis A: Canadian Institute for Health Information Discharge Abstract Database: A Validation Study. ICES Investigative Report. Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, 2006
14.
Tu K, Campbell NR, Chen ZL, Cauch-Dudek KJ, McAlister FA: Accuracy of administrative databases in identifying patients with hypertension. Open Med 2007; 1:e18–26
15.
Williams JI, Young W: A summary of studies on the quality of health care administrative databases in Canada, patterns of health care in Ontario, The ICES Practice Atlas, 2nd edition. Edited by Goel V, Williams JI, Anderson GM, Blackstein-Hirsch P, Fooks C, Naylor CD. Ottawa, Ontario, Canada, Canadian Medical Association, 1996, pp 339–45
16.
Ghali WA, Greenberg PB, Mejia R, Otaki J, Cornuz J: International perspectives on general internal medicine and the case for “globalization” of a discipline. J Gen Intern Med 2006; 21:197–200
17.
Whitcomb ME, Desgroseilliers JP: Primary care medicine in Canada. N Engl J Med 1992; 326:1469–72
18.
Wijeysundera DN, Austin PC, Beattie WS, Hux JE, Laupacis A: A population-based study of anesthesia consultation before major noncardiac surgery. Arch Intern Med 2009; 169:595–602
19.
Fleisher LA, Beckman JA, Brown KA, Calkins H, Chaikof EL, Fleischmann KE, Freeman WK, Froehlich JB, Kasper EK, Kersten JR, Riegel B, Robb JF: 2009 ACCF/AHA Focused Update on Perioperative Beta Blockade incorporated into the ACC/AHA 2007 Guidelines on Perioperative Cardiovascular Evaluation and Care for Noncardiac Surgery: A report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. Circulation 2009; 120:e169–276
20.
Technical Supplement: Health Care in Canada 2005. Ottawa, Ontario, Canada, Canadian Institute for Health Information, 2005
21.
Basinski ASH: Methods appendix: Procedures for abdominal aortic aneurysm and peripheral vascular disease, Cardiovascular Health and Services in Ontario: An ICES Atlas. Edited by Naylor CD, Slaughter PM. Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, 1999, pp 31
22.
Bourne RB, DeBoer D, Hawker G, Kreder H, Mahomed N, Paterson JM, Warner S, Williams J: Total hip and knee replacement, Access to Health Service in Ontario: ICES Atlas, 1st edition. Edited by Tu JV, Pinfold SP, McColgan P, Laupacis A. Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, 2005, pp 114–5
23.
Wijeysundera DN, Austin PC, Hux JE, Beattie WS, Buckley DN, Laupacis A: Development of an algorithm to identify preoperative medical consultations using administrative data. Med Care 2009; 47:1258–64
24.
Choudhry NK, Soumerai SB, Normand SL, Ross-Degnan D, Laupacis A, Anderson GM: Warfarin prescribing in atrial fibrillation: The impact of physician, patient, and hospital characteristics. Am J Med 2006; 119:607–15
25.
Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care 2005; 43:1130–9
26.
White RH, Gettner S, Newman JM, Trauner KB, Romano PS: Predictors of rehospitalization for symptomatic venous thromboembolism after total hip arthroplasty. N Engl J Med 2000; 343:1758–64
27.
Wijeysundera DN, Beattie WS, Austin PC, Hux JE, Laupacis A: Non-invasive cardiac stress testing before elective major non-cardiac surgery: Population based cohort study. BMJ 2010; 340:b5526
28.
Wijeysundera DN, Beattie WS, Karkouti K, Neuman MD, Austin PC, Laupacis A: Association of echocardiography before major elective non-cardiac surgery with postoperative survival and length of hospital stay: Population based cohort study. BMJ 2011; 342:d3695
29.
du Plessis V, Beshiri R, Bollman RD, Clemeson H: Definitions of “rural,” Agriculture and Rural Working Paper Series, No. 61. Ottawa, Ontario, Canada, Statistics Canada, 2002
30.
Iron K, Zagorski BM, Sykora K, Manuel DG: Living and Dying in Ontario: An Opportunity for Improved Health Information. Toronto, Ontario, Canada, Institute for Clinical Evaluative Sciences, 2008
31.
Mamdani M, Sykora K, Li P, Normand SL, Streiner DL, Austin PC, Rochon PA, Anderson GM: Reader's guide to critical appraisal of cohort studies: 2. Assessing potential for confounding. BMJ 2005; 330:960–2
32.
Birkmeyer JD, Siewers AE, Finlayson EV, Stukel TA, Lucas FL, Batista I, Welch HG, Wennberg DE: Hospital volume and surgical mortality in the United States. N Engl J Med 2002; 346:1128–37
33.
Mittlböck M, Schemper M: Explained variation for logistic regression. Stat Med 1996; 15:1987–97
34.
Larsen K, Merlo J: Appropriate assessment of neighborhood effects on individual health: Integrating random and fixed effects in multilevel logistic regression. Am J Epidemiol 2005; 161:81–8
35.
Lin DY: Cox regression analysis of multivariate failure time data: The marginal approach. Stat Med 1994; 13:2233–47
36.
Wennberg JE: Dealing with medical practice variations: A proposal for action. Health Aff (Millwood) 1984; 3:6–32
37.
Task Force for Preoperative Cardiac Risk Assessment and Perioperative Cardiac Management in Non-cardiac Surgery; European Society of Cardiology (ESC), Poldermans D, Bax JJ, Boersma E, De Hert S, Eeckhout E, Fowkes G, Gorenek B, Hennerici MG, Iung B, Kelm M, Kjeldsen KP, Kristensen SD, Lopez-Sendon J, Pelosi P, Philippe F, Pierard L, Ponikowski P, Schmid JP, Sellevold OF, Sicari R, Van den Berghe G, Vermassen F. Guidelines for pre-operative cardiac risk assessment and perioperative cardiac management in non-cardiac surgery. Eur Heart J 2009; 30:2769–812
38.
Qaseem A, Snow V, Fitterman N, Hornbake ER, Lawrence VA, Smetana GW, Weiss K, Owens DK, Aronson M, Barry P, Casey DE Jr, Cross JT Jr, Fitterman N, Sherif KD, Weiss KB, Clinical Efficacy Assessment Subcommittee of the American College of Physicians: Risk assessment for and strategies to reduce perioperative pulmonary complications for patients undergoing noncardiothoracic surgery: A guideline from the American College of Physicians. Ann Intern Med 2006; 144:575–80
39.
Wijeysundera DN, Austin PC, Beattie WS, Hux JE, Laupacis A: Outcomes and processes of care related to preoperative medical consultation. Arch Intern Med 2010; 170:1365–74
40.
Lee TH, Marcantonio ER, Mangione CM, Thomas EJ, Polanczyk CA, Cook EF, Sugarbaker DJ, Donaldson MC, Poss R, Ho KK, Ludwig LE, Pedan A, Goldman L: Derivation and prospective validation of a simple index for prediction of cardiac risk of major noncardiac surgery. Circulation 1999; 100:1043–9
41.
Huddleston JM, Long KH, Naessens JM, Vanness D, Larson D, Trousdale R, Plevak M, Cabanela M, Ilstrup D, Wachter RM, Hospitalist-Orthopedic Team Trial Investigators: Medical and surgical comanagement after elective hip and knee arthroplasty: A randomized, controlled trial. Ann Intern Med 2004; 141:28–38
42.
Stukel TA, Lucas FL, Wennberg DE: Long-term outcomes of regional variations in intensity of invasive vs  medical management of Medicare patients with acute myocardial infarction. JAMA 2005; 293:1329–37
43.
Correll DJ, Bader AM, Hull MW, Hsu C, Tsen LC, Hepner DL: Value of preoperative clinic visits in identifying issues with potential impact on operating room efficiency. ANESTHESIOLOGY 2006; 105:1254–9
44.
Tsen LC, Segal S, Pothier M, Hartley LH, Bader AM: The effect of alterations in a preoperative assessment clinic on reducing the number and improving the yield of cardiology consultations. Anesth Analg 2002; 95:1563–8
45.
Romano PS, Chan BK, Schembri ME, Rainwater JA: Can administrative data be used to compare postoperative complication rates across hospitals? Med Care 2002; 40:856–67
46.
Dimick JB, Welch HG, Birkmeyer JD: Surgical mortality as an indicator of hospital quality: The problem with small sample size. JAMA 2004; 292:847–51