Home >Newsletters >April 2005>News
 
ASA NEWSLETTER
 
 
April 2005
Volume 69
Number 4

Committee on Research: A Review of What We Do

Michael K. Cahalan, M.D., Chair
Committee on Research


he ASA Committee on Research has 17 members and three principal responsibilities: assessing the scientific merit of research grants submitted for Foundation for Anesthesia Education and Research (FAER) awards, judging submissions for the ASA Residents’ Research Essay Contest and selecting the ASA Presidential Scholar Award. I would like to describe in brief each of these activities.

FAER Awards

Twice a year, the committee receives approximately 20-30 research grant applications. The applications are distributed to all members of the committee, and each grant is assigned to two committee members who serve as principal reviewers by completing a systematic, independent, written review of the grant. Thereafter the reviews of the principal reviewers are exchanged in advance of the committee meeting. One meeting is held in spring and one just before the ASA Annual Meeting in October. During the committee meeting, the findings of the principal reviewers are presented to the entire Committee on Research, and the strengths and weaknesses of the applications are discussed in detail. Then each committee member is asked to score the grant according to a standardized evaluation system [Table 1].

Table 1: Standardized Evaluation System for Scoring Grants


EVALUATION
DESCRIPTION
PRIORITY SCORE
Qualitative
Enthusiasm
   
Outstanding
Highest
Well-thought-out application on an important topic and/or with great potential for future funding.
1.0 to 1.5
Excellent
Very high
Only minor defects keep grant from the top category and/or with reasonable potential for future funding.
1.6 to 2.0
Good
Highest
Some important defects that could be easily corrected and/or with good potential for future funding.
2.1 to 2.5
Satisfactory
Above average
Multiple defects but correction should be possible and/or with fair potential for future funding.
2.6 to 3.0
Adequate
Below
average
Correction of defects may require changes in approach and/or with low potential for future funding.
3.1 to 3.5
Fair
Low
Major defects in approach or selection of research problem and/or with low potential for future funding.
3.6 to 4.0
Unacceptable
Little
Defects in approach or problem unlikely to be correctable and/or with low potential for future funding.
4.1 to 5.0

After all of the grants have been reviewed in this systematic fashion, the average score for each application is tabulated, and the applications are ranked from strongest to weakest. This information is provided to the FAER Board of Directors for decisions regarding funding. In addition the written reviews from the principal reviewers as well as a synopsis of the committee’s discussion are provided to the FAER office. The committee members make every effort to provide constructive criticism in the review process that will help the applicants strengthen their research project and future applications, whether to FAER or other granting sources such as the National Institutes of Health. Indeed a substantial number of FAER award winners have been funded after resubmission and substantial improvement in their applications.

In part this process depends on assigning the applications to scientists with special expertise in the area proposed for investigation. As the committee chair, I am grateful for the exceptionally diverse range of expertise on our research committee. The comprehensive reviews provided by committee members can take many hours or even days to complete. When their efforts lead to substantial improvement in the design of research in the field of anesthesiology, however, those contributions may be very far-reaching.

Residents’ Essay Contest
The second responsibility of the committee is judging the ASA Residents’ Research Essay Contest. Typically the committee receives 10-20 essays to review, and all committee members are asked to read these essays carefully and rank them from strongest to weakest. Because the range of topics covered in the essays can be extraordinarily wide, this is no small task for our members. After all of the results are tabulated, a clear ranking may be established or a re-evaluation of the strongest essays may be necessary in order to determine first-, second-, and third-place winners. Both the potential scientific impact of the work as well as the quality of scientific writing are factors in the judging process. The results of the committee’s deliberations are forwarded to the ASA Executive Office, and the essay contest winners are announced at the ASA Annual Meeting.

Presidential Scholar Award

The third and newest responsibility is the selection of the Presidential Scholar Award winner. During his term as President in 2003, James E. Cottrell, M.D., created the Presidential Scholar Award to highlight research by young faculty in anesthesiology departments. The Committee on Research reviewed the first applications for this award in spring 2003. Nominees for the award are required to be within the first seven years of their first appointment in their department of anesthesiology. Other qualifications include certification by the American Board of Anesthesiology, ASA membership and a career that is both clinically active and scientifically productive. Personally this has been one of the most enjoyable aspects of participating on the ASA Committee on Research, and reading about the accomplishments of these extraordinary young anesthesiologists has been inspiring. Applications for the Presidential Scholar Award are reviewed in detail by all committee members. Just as is the case in evaluation of the essay applications, the evaluation of the Presidential Scholar applicants is done independently by committee members, and their evaluations of the standardized application are tabulated. When no clear winner is evident after the first round of evaluations, subsequent rounds are conducted as necessary in order to impartially select the award winner.

In all of the deliberations of the committee, any member with a potential conflict of interest is excused from voting for that applicant or discussions involving that application. As an example, when a FAER application is discussed by the committee, any member of the committee from that applicant’s department or with any personal connection to that applicant is excused from the committee presence and does not vote on that application.

As you can see, the ASA Committee on Research is a busy and hard-working committee. I am grateful for the devoted service that the members of the committee provide to our Society and to our specialty. It is an honor and a pleasure for me to chair such a distinguished group.



    Michael K. Cahalan, M.D., is Professor and Chair, Department of Anesthesiology, University of Utah School of Medicine, Salt Lake City, Utah.
Michael K. Cahalan, M.D.

 


return to top


 

FEATURES

Obstetric Anesthesiology: Delivering Quality Care

ARTICLES


DEPARTMENTS


The views expressed herein are those of the authors and do not necessarily represent or reflect the views, policies or actions of the American Society of Anesthesiologists.

2005 NL Subject Index

2005 NL Author Index

NL Archives

Information for Authors