Reviewer Guidelines: Research Articles

Analytics operates at the intersection of many fields, including writing studies, educational measurement, massive data analysis, digital learning ecologies, and ethical philosophy. Intended to give voice to an emerging community, the journal is devoted to programs of research providing evidence of fair, reliable, and valid analytics. 

We have provided detailed Author Guidelines for Research Articles. Based on those guidelines, the categories below ask reviewers to make a series of analytic judgements on each section of the manuscript. After providing scores, reviewers are then asked to provide notes in which they justify and explain their assessment of the given section of the manuscript.

Publishing Recommendation

Please select only one recommendation:	Publish as is	Publish with minor changes	Revise and resubmit	Reject
Please briefly explain your decision:

Comment Category 1: Abstract

The abstract (between 200 and 300 words) presents a comprehensive overview of the study.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Abstract:

Comment Category 2: Background

The background section positions the study while explaining its significance. This section includes information on the following: the study's focus; the study's relevance to readers of the Analytics; and the research question or problem statement that the study addresses. The background section concludes with a brief overview of the significance of the study.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Background:

 

 

Comment Category 3: Literature Review

The literature positions the reported research in the context of work by other researchers, identifies needed advances, and establishes justification for the present study.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Literature Review:

Comment Category 4: Research Questions

The research questions are framed in terms of needed work identified in the literature review. The research questions should also align the needed work with the chosen research methodology.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Research Questions:

Comment Category 5: Research Methodology

The research methodology section consists of a comprehensive description of how the study was executed. The section is written so that others should be able to replicate the study. The structure typically includes information on design, sequence, collection, sampling, and analytic method. When describing data collection, the authors provide information about the following aspects, as appropriate for the study.

• Research design: Authors provide a description of the general study design and position the study within known and developing programs of research.
• Sampling Plan:
• The method for securing the sampling plan is described.
• Authors include a statement indicating that the study was approved by a Research Ethics committee or that it was exempt from approval.
• The number of participants is disclosed, along with their demographic information and other relevant characteristics.
• Authors use power analysis used to support inferences from the study sample to the general population at hand.
• Attrition is reported.
• Instruments: Authors identify the empirical methods used in the study and the aims of these methods. They describe the kind of information collected, with qualification established as necessary to aid later discussion.
• Procedures: Authors provide a step-by-step description of how data were collected.
• Data analysis: Authors describe how the data were analyzed and provide justification for the analytic methods used.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Research Methodology:

Comment Category 6: Results

The results section provides evidence that the research questions have been addressed. Results are reported according to standards identified by the American Psychological Association in terms of sample size, disaggregation by sub-group, descriptive and inferential statistics, and effect size. Foundational categories of evidence related to fairness, validity, and reliability are essential.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Results:

Category 7: Discussion

The discussion section provides interpretation, use, and consequences of the results. Attention is also given to claims, warrants, and qualifications regarding the evidence presented.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Discussion:

 

Category 8: Conclusions

The conclusion section provides justification that the results have answered the research questions with any attendant qualifications. Special attention is e paid to applications, especially to groups of diverse learners. Special attention should be paid to qualifications, especially as related to fairness as a category of evidence.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Notes on Conclusion:

Category 9: Directions for Further Research

The authors have concluded the manuscript with directions for further research intended to advance the body of knowledge and program of research reported in the study.

Very Strongly Agree	Strongly Agree	Agree	Disagree	Strongly Disagree	Very Strongly Disagree
6	5	4	3	2	1

Reviewer Notes

Please provide any additional integrative notes on the manuscript related to your publishing recommendation.