Reviewer Guidelines: New Quantitative Techniques

Analytics operates at the intersection of educational measurement, massive data analysis, digital learning ecologies, and ethical philosophy. Intended to give voice to an emerging community, the journal is devoted to programs of research providing evidence of fair, reliable, and valid analytics. Dedicated to application, such multidisciplinary research will demonstrate its usefulness to educational stakeholders as they expand opportunities for diverse learners.

To advance this new area of research, we have provided detailed Author Guidelines for New Quantitative Techniques. Based on those guidelines, the categories below ask reviewers to make a series of analytic judgements on each section of the manuscript. After providing scores, reviewers are then asked to provide notes in which they justify and explain their assessment of the given section of the manuscript.

Publishing Recommendation

Please select only one recommendation:

Publish
as is

Publish with minor changes

Revise and resubmit

Reject

Please briefly explain your decision:

Comment Category 1: Structured Abstract

The structured abstract (between 500 and 750 words) is categorized by subheadings to include identification of the quantitative technique, establishment of its value, demonstration of an application of the technique, and proposed directions for further research.

Very Strongly Agree

Strongly Agree

Agree

Disagree

Strongly Disagree

Very Strongly Disagree

6

5

4

3

2

1

Notes on Structured Abstract:

Comment Category 2: Technique Identification

The identification of the technique positions the quantitative method under examination and explains its significance. In doing so, this section includes information on the origin and development of the technique under examination as well as the research capability of the technique to advance writing analytics

Very Strongly Agree

Strongly Agree

Agree

Disagree

Strongly Disagree

Very Strongly Disagree

6

5

4

3

2

1

Notes on Technique Identification:

Comment Category 3: Value Contribution

The exposition includes information that positions the technique as it advances evidence related to fairness, validity, and reliability. As well, information is provided centers the technique in traditions such as classical test theory, generalizability theory, and item response theory. The proposed value is very specific in terms of the power of the method to add to knowledge related to evidential categories of fairness, validity, and reliability.

Very Strongly Agree

Strongly Agree

Agree

Disagree

Strongly Disagree

Very Strongly Disagree

6

5

4

3

2

1

Notes on Establishing the Value Contribution:

Comment Category 4: Technique Application

The application section describes the usefulness of the technique. Examples should be used with existing data sets so that readers will be able to quickly realize the force of the technique. Methodology here is important so that other researchers may use the technique in their own research.

Very Strongly Agree

Strongly Agree

Agree

Disagree

Strongly Disagree

Very Strongly Disagree

6

5

4

3

2

1

Notes on Technique Application:

Comment Category 5: Directions for Further Research

Authors should conclude the manuscript with directions for further research that the technique affords. Special attention should be paid to the principles that will guide future research.

Very Strongly Agree

Strongly Agree

Agree

Disagree

Strongly Disagree

Very Strongly Disagree

6

5

4

3

2

1

Notes on Directions for Further Research:

Reviewer Notes

Please provide any additional integrative notes on the manuscript related to your publishing recommendation.