Most likely, this is the plot that will be used in the final manuscript. The plots were created individually in Rstudio with the ggplot package. They were then stacked together with the patchwork package to create one image. I intend to save this image and upload it into PowerPoint to add the dashed line between baselines and text identifiers (e.g., phases, participants).
Interpreting the Plot:
The top plot represents participant 2, the middle plot represents participant 1, and the bottom plot represents participant 3. The participants are stacked in this order to adhere to the randomization of IV implementation.
Visual Analysis characteristics to consider:
Autocorrelation: The results of the MLM analysis obtained a autocorrelation value of .494, suggesting moderate, positive autocorrelation. This value may affect visual analysis, specifically Type I Error, which suggests an intervention is effective when it is not.
Baseline Stability: As mentioned in the proposal, baseline stability was not anticipated for all participants as the delivery of psychoeducation was likely to have some effect on the status tracking measurement used for visual analysis and to determine the existence of a functional relation. Participant 2 (top plot) only obtained three baseline data points, but her final baseline data point was her highest baseline value and jumped from her lowest baseline data point during session two. This suggests her baseline phase was not stable. Participant 1 demonstrated the most consistent and stable baseline phase. Participant 3 demonstrated the strongest, positive trend during baseline phase. Although this could be a result of spending the most time in the baseline phase, participant 3’s baseline data displays a gradual increase across the entire phase.
Trend: As discussed in the proposal, the evaluation as trend is not as critical to identifying the existence of a functional relation, due to the likelihood of baseline instability and rising baseline trend. I think the most critical aspect of trend to consider is the participant 2’s obtained data during the experimental phase. Participant 2 obtained 10 experimental sessions, the longest of any participant, and her obtained data demonstrated no consistent trend during this phase. Rather, her obtained was the most volatile during this phase. Of positive not, participant 1 completed the experimental phase on a positive trend, while participant 3 maintained a stable trend throughout the experimental phase.
Level: One of two very important aspects of visual analysis to consider to determine the existence of a functional relation for this study. Participant 1 demonstrated the cleanest change in level between the two phases, supporting the existence of a functional relation. Although participant 2’s highest data points point towards the direction of a change in level between phases, her overall volatility in the experimental phase make it challenging to point on a consistent change in level. Participant 3 demonstrates a change in level between her first four baseline data points and experimental data points. However, her last four baseline data points are near the same level as the experimental data points, suggesting a consistent change in level did not occur for this participant.
Immediacy of Effect: The other critical aspect of visual analysis to consider to determine the existence of a functional relation for the study. Only participant 1 demonstrated a consistent jump in performance upon the implementation of the IV to demonstrate the immediacy of effect of the IV. Participant 2 immediately decreased in her performance upon the implementation of the IV, but she then demonstrated a strong increase to reach her first peak in the experimental phase data. Therefore, participant 2 demonstrated slight immediacy of effect, but this first peak of performance was followed by a sharp decrease until the second peak occurred at the end of the study. Finally, participant 3 demonstrated no immediacy of effect following the implementation of the IV. Her experimental phase data points remained on the same level as her final four baseline data points.
Final Decision: I don’t think a functional relation can be determined through visual analysis. Visual analysis should be the north star of SCR analysis, and I will use the MLM and Tau-U results to provide an overarching discussion of what the data reveals. Overall, there appears to be a benefit of treatment, but within the current design and research question, it is challenging to conclude a functional relation exists between the addition of individualized cognitive strategy instruction to psychoeducation and the achievement of student RTL targets.
Manuscript Graph
SCAN Demonstration
These are plots created with the SCAN package, which is a R packaged designed specifically to plot and analyze single case research data.