Quantitative Article Review

Choose an article that gives a clear demonstration of one of the required quantitative methodologies. Designate which methodology on the title page. Include as many of the following as appropriate:

I. Introduce the topic, include article title and author(s)

II. Research Problem

• What is the reason/purpose for the research?

• What problem was it trying to solve?

• Is the problem stated clearly and succinctly?

• Is background information on the problem presented?

• Is the problem important and relevant? Why or why not?

• Is the significance of the problem discussed; how the study will add to the “body of knowledge”?

• Does the problem communicate whether the study is descriptive, experimental or non-experimental?

• Does the problem statement indicate the variables of interest and the specific relationship between those variables which are investigated? When necessary, are variables directly or operationally defined?

III. Review of Literature

• Does the review of literature seem comprehensive? Are all important previous studies included? Does it include studies that you know to be relevant to the problem?

• Are up-to-date primary sources emphasized?

• Have studies been critically reviewed, flaws noted and have the results been summarized?

• Does the review synthesize studies directly related to the problem?

• Does the review explicitly relate previous studies to the problem?

• Is the review logically organized?

• Does the review establish a theoretical framework for the significance of the study?

• Does the review identify a “gap” in the literature?

IV. Research Question(s) & Hypotheses

• What is the research question(s) and corresponding hypothesis(es)?

• Does the research question follow from the literature?

• What are the independent and dependent variables?

• Is the hypothesis clear and concise and stated in declarative form?

• Does the hypothesis state expected relationships or differences?

• Is each hypothesis testable?

V. Selection of Participants

• What is the population? Is the population clearly defined?

• Are the size and major characteristics of the population studied described?

• If a sample was selected, what is the method of selection and recruiting the sample?

• Is the method of sample selection clearly described? Is it one that is likely to result in a representative, unbiased sample?

• Are the size and major characteristics of the sample described?

• Does the sample size meet the suggested guideline for minimum sample size appropriate for the method of research represented?

• Is there adequate assurance that the rights of human participants were protected?

VI. Instrumentation

• What instruments were used for datacollection?

• Is the rationale given for the selection of the instruments (or measurements) used?

• Is each instrument described in terms of purpose and content?

• Are the instruments appropriate for measuring the intended variables?

• Is evidence presented that indicates that each instrument is appropriate for the population under study?

• Is instrument validity discussed and coefficients given if appropriate?

• Is reliability discussed in terms of type and size of reliability coefficients?

• If appropriate, are subtest reliabilities given?

• If an instrument was developed specifically for the study, are the procedures involved in its development and validation described?

VII. Design and Procedure

• Is the design appropriate for answering the questions or testing the hypotheses of the study?

• Are the procedures described in sufficient detail to permit them to be replicated by another researcher?

• If a pilot study was conducted, are its execution and results described as well as its impact on the subsequent study?

• Are the control procedures described?

• Did the researcher discuss or account for any potentially confounding variables that he or she was unable to control for?

VIII. Analysis and Results. [Note this is the “heart” of the review for this course. Be SURE that you demonstrate an understanding of the statistical method used and the analysis presented. Include specific results, don’t just say they are in the article. If there is no hypothesis specifically given you should be able to write it out based on the method and discussion.]

• What are the specific results? (Use correct terminology and format for the statistical methodology. Make it clear you understand the method)

• Are appropriate descriptive statisticspresented?

• Was the probabilitylevel at which the results of the tests of significance were evaluated specified in advance of the data analyses?

• If parametric testswere used, is there evidence that the researcher avoided violating the required assumptions for parametric tests?

• Are the statistical tests of significance described appropriate, given the hypotheses and design of the study?

• Was every hypothesis tested?

• Are the tests of significance interpreted using the appropriate degrees of freedomand effect size?

• Is lack of statistical significance properly interpreted?

• Are the results clearly presented?

• Are the tables and figures (if any) well organized and easy to understand?

• What are the key results of the paper? Are they complete?

• Do the results address the problem that the paper was trying to solve?

• Is each result discussed in terms of the original hypothesis to which it relates?

• Are the possible effects of uncontrolled variables on the results discussed?

• Is each result discussed in terms of its agreement or disagreement with previous results obtained by other researchers in other studies?

• Are the results reproducible?

IX. Conclusions

• Are generalizations consistent with the results?

• Are theoretical and practical implications of the findings discussed?

• Are recommendations for future research made?

• Are the assumptions and limitations of the study clearly stated?

• Was there information that the author omitted that you felt should have been included? What was the overall value added contribution the article offers? Does the article pass the “so what” test?

• Did the researcher answer the stated research question? Did you learn anything significant through this review process?

• Was the research well presented? What are strengths and weaknesses of the article?

• Describe how it may or may not be helpful to you in furthering your research goals.

X. References

Quantitative Article Review

Choose an article that gives a clear demonstration of one of the required quantitative methodologies. Designate which methodology on the title page. Include as many of the following as appropriate:

I. Introduce the topic, include article title and author(s)

The reviewed article is about the relevant school leadership and business management. The title of the article is “Increasing the Quantity and Quality of School Leadership Candidates through Formation Experiences” and the authors are: Joseph R. Busch, Thomas P. O’Brien and William D. Spangler.

II. Research Problem

The purpose of the research is to develop a multimethod research study to determine the effectiveness of the project in enhancing participants’ leadership skills and their interest in pursuing educational leadership certification.

The problem which the authors are trying to solve is to increase the quantity and quality of school leadership candidates through formation experiences. The problem is stated clearly and succinctly background information on the problem presented. The problem is important and relevant because schools are facing high turnover in administrative positions and candidate pools for the positions are often inadequate.

The significance of the problem is discussed in the introductory part, where similar examples from different studies are presented. The problem communicates whether the study is experimental since the results are based on an experiment with teachers who participated in an eight-month personal and professional development program, which included interpersonal leadership styles analysis, professional action planning.

The quantitative measures used in this study included two reaction surveys, a measure for role-play assessments, a measure for the assessment of in-basket scenarios, the 14 Item Multifactor Leadership Questionnaire, and a questionnaire on educational and career plans.

III. Review of Literature

The review of literature seems comprehensive. It focuses on three topics: (a) the implications of current “reform” efforts for school leaders and school leadership candidates, (b) the identification of standards and competencies for school leaders, and (c) the need for innovative developmental processes for the education of prospective school leaders and includes the most important articles in this area, such as: Deal & Peterson, 1990; Bolman & Deal, 1994; Murphy, 1992; McEwen, 1995; Murphy, 1992; Restine, 1997 and Walter & Sharp, 1998. The studies have been critically reviewed, flaws noted and have the results been summarized.

The review synthesize studies directly related to the problem as most of the above mentioned articles are focused on the identification of standards and competencies necessary for effective school leadership. The …

The expert reviews a statistical article. A quantitative analysis is provided.