OLOR Series: | Research in Online Literacy Education |
Author(s): | Miriam R. Bourgeois and Genie N. Giaimo |
Original Publication Date: | 15 September 2019 |
Permalink: |
<gsole.org/olor/role/vol2.iss2.c> |
The Ohio State University's Writing Center has implemented three models of asynchronous online support with varying degrees of success: two-step asynchronous consultations, one-step drop-off consultations, and the Online Accountability Writing Group. After conducting assessment, the researchers found that less structure led to higher levels of engagement, as evidenced by increased participation and retention. Our study fills a gap in the research in that it shares findings from one-on-one and group asynchronous online support.
Keywords: asynchronous, online, drop-off, live-chat, remote, in-Person, face-to-face, consultations, tutorials
3. Background and Context[6] In January 2015, the OSU Writing Center launched the first iteration of asynchronous online writing consultations since the center's inception in the 1970s. The timeline documenting this transition is visible in Figure 1. Initially unpopular, asynchronous consultations underwent several transitions in areas such as marketing and scheduling. Over two years, asynchronous online sessions evolved from a seven-day two-step process (Appendix A); to a five-day two-step process (Appendix B); to a streamlined and simplified one-day one-step process (Appendix C). |
[7] The first two Async models included two-step feedback processes that required clients to revise their writing in between the first and second rounds of feedback provided by the tutor. The first Async model took seven days to complete. Clients would submit their writing on Monday and receive the final round of feedback on Sunday. The second Async model condensed this process to five days, starting on Monday and ending on Friday. This two-step Async model was never as popular as face-to-face (f2f) consultations. Although attempting to recreate the collaborative aspects of a f2f session, the two-step process proved to be bulky, time-consuming, and ultimately less engaging for clients. Typically, clients would not complete the second step of the Async process, thereby “no-showing” under the then-current tracking and engagement policies. F2f consultations, on the other hand, did not require a follow-up session within a prescribed seven-day or five-day period. Thus, in trying to establish an environment similar to f2f consulting, the two-step Async consulting model failed to capture the sustained engagement of clients, which led to under-utilization and client attrition. The third Async model, “Drop-Off Consultations,” closely followed the in-person model, in that tutors offered one round of feedback to clients in 45-minute “sessions.” [8] We ultimately found the one-step Drop-Off model to be most effective insofar as clients utilized it frequently and persistently. After a year, two-step Async consultations were replaced entirely by one-step Drop-Off Consultations. The one-step Drop-Off consultation model is effective for OSU because it retains many of the aspects of f2f consultations. Drop-Off consultations, like f2f consultations, are 45 minute, one-step consultations that do not require multiple submissions or multiple rounds of feedback. Additionally, in both f2f and Drop-Off consultations, tutors offer a variety of marginal comments as well as revision plans with encouragement to re-submit revised materials under another appointment. Both types of consultations also follow the same formal guidelines for providing feedback, such as setting an agenda, offering encouragement and specific modeled feedback, providing advice (rather than directions) for revision possibilities, and encouraging continued engagement with WC services. Finally, in Drop-Off sessions, tutors are trained to accommodate clients' specific feedback requests, much like in synchronous sessions. This model ultimately enables clients to move with ease between in-person and Online Drop-Off consultations, as both types of sessions now share similar models. This streamlining also makes hiring consultants for these sites more seamless, though they still do require some additional training. [9] Flexibility rather than control ultimately proved to be critical in fostering engagement in the consulting process. Where the Async model failed to take hold was in the transition from the first round of submission and feedback to the second round of submission and feedback. Clients either did not understand the process, could not engage in the process, or did not want to engage in the process. Whatever the case may be, eliminating the second step and establishing similar practices to f2f sessions helped create continuity across different support services, which encouraged cross-service usage, between drop-off sessions and synchronous ones. |
6. Results: An Overview of Needs and Engagement Styles of Online Writing Group Participants[22] Each semester, participants' reactions to the Async Writing Group were measured by their responses to the pre-and-post writing group surveys. Of 22 participants who filled out a pre-writing-group survey over the four semesters, only three joined the group for support with technical aspects of writing (improving the writing process, learning strategies for revision, improving English language writing fluency, learning more about a specific type or genre of writing, or receiving feedback from someone outside of their department). The other 19 responders joined to receive support with setting regular writing goals, setting aside dedicated time and space for writing, and being provided with writing accountability. [23] Over the four semesters, only 12 participants responded to a post-writing group survey. A quarter of these respondents (four) believed that participating in the writing group helped them achieve their writing goals. The remaining eight respondents indicated that they were dissatisfied with the group (for reasons unrelated to the group facilitator). Of the eight dissatisfied responders, only two specified the reasons for their dissatisfaction. Both responses attributed their dissatisfaction to a lack of incentive to participate in the group. One respondent noted, “It turns out that I need an in-person group to actually be held accountable.” The other respondent noted that “there was no accountability in the accountability writing group.” 6.1. Changes in Group Format Across Four Semesters[24] The Async Writing Group is an informal educational space (i.e. non-credit bearing elective and extracurricular), where rules such as regular attendance, which are endemic to formal educational settings, might not be successful. Therefore, changes were made over four semesters to the Online Writing Group to reflect the unique circumstances of the educational space, as well as in response to participant feedback and attendance numbers. [25] Because of the novel nature of the online writing group model, we established course syllabi for each iteration of the group. From the first iteration of the group (Appendix D), in Summer 2017, to the current syllabus (Appendix E), many changes were made. The syllabi reflect changes made to the online group, including replacing the weekly exercise with a collaborative sheet to track writing progress. [26] In the Summer 2017 group, the facilitator would upload a short video to the LMS each week, along with a low-stakes writing assignment, such as creating a concept map, completing a style exercise, or signing up for a bibliography program and creating a brief bibliography. Resources related to the week's theme were also uploaded. Each week, the facilitator would also have appointment-based online office hours via the LMS’ conference feature. Participants were expected to complete each week's assignment and compose a written response that was uploaded to the LMS. Responses were not graded, but the facilitator offered feedback on the tasks by request. [27] In the Autumn 2017 Async Writing Group, assignments were made optional, rather than being one of the determiners of participation and engagement. Group participants reported looking for extra support and motivation in their own writing and noted that a required assignment wasn't helping them achieve these goals. A weekly discussion thread was also added, so that participants could track and share their weekly writing progress and goals for the upcoming week. This addition helped create community, which was, perhaps, missing from the Summer 2017 group. As Olson-Horswill (2002, p. 189) attests, discussion boards in a remote writing group can offer a space that encourages participants to think critically and communicate with each other. [28] Between Autumn 2017 and Spring 2018, most other formal aspects of the group remained the same. The discussion thread for progress and goals, however, was expanded to include weekly questions regarding progress and goals. This was done to encourage participation and further community-building among participants in the cohort. [29] Significant changes were made to the Summer 2018 group based on attendance and participation numbers, as well as participant feedback (Appendix E). As participants engaged with the video lesson and assignment minimally, the formal lesson plan was replaced with new components aimed to help participants keep track of their daily writing progress and weekly writing goals. The assignment component was removed altogether. Without an accompanying assignment, the video lessons were less central to group engagement. Participants collectively tracked their daily writing progress in a shared Excel spreadsheet, as well as compared their progress to other participants' progress. Additionally, the weekly progress and goals discussion thread became a more central component of the group, as weekly questions were posted in order to encourage reflection and self-assessment. Ultimately, the new interactive elements worked in tandem to encourage productivity and success among group participants in setting and meeting measurable and manageable writing goals. 6.2. Overall Participation[30] 6.2.1. Enrollment and Total Participation.Enrollment and participation were tracked each semester. There were relatively similar numbers of enrollment in Summer 2017, Autumn 2017, and Spring 2018, with enrollment more than doubling for the Summer 2018 Group (Figure 2). 13 people enrolled for the Summer '17 group, 10 people enrolled for both the Autumn '17 and Spring '18 groups, and 30 people enrolled in Summer '18. Total enrollment for Summer '18 was higher than in previous semesters, due in part to increased promotion of all Writing Groups to OSU departments and advertisement in official University communications. Additionally, there were two returning participants from Spring '18.
[31] Total participation in the group each semester is reflected in Figure 2. The only trend from total participation numbers is that summer groups tend to yield lower participation per enrollee (4.5 – 4.6 engagements) than autumn (11.9 engagements) and spring terms (8.7 engagements). The total participation number, for each semester and each group, is the sum total of participation from each week. |
[32] 6.2.2. Weekly Participation.Total participation varied week-by-week, as shown in Figure 3. Participation was initially high in the Summer '17 group but subsequently dropped and then remained consistent for the duration of the semester. Participation remained fairly consistent in the Autumn '17 group throughout most of the semester, dropping off slightly at the end. Similar to the Autumn '17 group, weekly participation in the Spring '18 group started off high, with 10 participants participating weekly for the first three weeks. By week six, participation dropped by about half, but remained steady (5–6 weekly participants) for the remaining weeks. More participants participated each week during Summer '18 than in previous groups, at an average rate of 15 people per week, though adjusting for high enrollment, the rates of participation were similar to other groups.[33] Based on this data, we can see that participation trends differed between Summer semesters and Autumn and Spring semesters, with a more consistent participation during Autumn 2017 and Spring 2018 and a marked drop-off in participation within the last two weeks of Summer '17 and '18. In other words, writing group participation was less steady during Summer groups than groups run during the Autumn and Spring semesters. |
[34] 6.2.3. Participation Rates per Participant. Participation rate per participant also varied. As Figure 4 illustrates, participants engaged an average of approximately four times each over the Summer '17 and '18 semesters. We suggest that low but consistent participation is due to the group's focus on the lesson plan and mandatory assignments. The individual participation rate was much higher in the Autumn '17 group, with participants engaging an average of almost 12 times each. Participation rates were slightly lower in the Spring '18 group, with participants engaging an average of approximately 9 times. Despite the higher numbers of weekly participants during Summer '18, individual participants actually engaged almost half as frequently as in Spring '18.
|
6.3. Engagement in Groups by Individual Participation Metric[35] All four versions of the Async Writing Group required participation for continued enrollment in the LMS site and group. Figure 5 tracks the total number of engagements by each participation metric for each semester. Metrics included: discussion board posts, assignments submitted, LMS visits, and progress tracking via Excel. In the final group, the assignment metric was replaced by the progress tracking metric; however, no participant accessed the LMS site without also participating in either progress tracking or the discussion board. As shown in Figure 5, after the first group in Summer '17, there was a large decline in engagement with assignments. Conversely, discussion board posts increased. |
[36] 6.3.1. Discussion Boards.Aside from the lesson devoted to goal setting and accountability, the Summer '17 Online Accountability Group did not offer much ongoing support for accountability and goal setting. Participants were encouraged to create new discussion threads, but after the first thread for introductions (in which every participant posted), no further discussion threads were created. Unsurprisingly, then, there were only 15 discussion posts in the semester (Figure 5), which accounted for 26% of total participation, with an average of one discussion post per participant.
[37] In the Autumn '17 Group, participation in the discussion boards quickly dwindled. With only 20 discussion posts all semester (Figure 5) over one discussion thread, discussion posts accounted for 17% of total participation. [38] In Spring '18, however, participation increased from roughly one to three posts per participant each week (Figure 5). During this group, the discussion board was amended to focus on progress and goals. In the Spring '18 group, 48 total discussion board posts were made, which accounted for over half (55%) of entire participation in the group. [39] Without an assignment feature for the group in Summer 2018, the discussion board was even more popular. With 76 unique posts, and 10 replies to other participants’ posts, discussion boards made up over half (56%) of the participation, with approximately 2.5 total posts per participant. The board questions were more direct and tailored to prompt reflection and response (e.g. What were the best and worst things that happened with your writing/research last week? What are your writing, research, and planning goals for the coming week? What citation styles and programs do you use, and was the video lessons on citations helpful at all?) [40] 6.3.2. Assignments.In the Summer '17 group, at least two participants either submitted assignments or logged onto the LMS site weekly and accessed resources (Figure 5). With 39 assignments submitted, assignments accounted for most (65%) of the groups' participation. And even though assignments were no longer a required element of the Autumn '17 course, at least one participant submitted an assignment almost every week. 17 assignments were submitted by six different participants, amounting to 14% of total participation. As the group's focus shifted away from the assignment and toward more collaborative activities, participants stopped submitting assignments. In Spring '18, assignments were only submitted on 2 out of 12 weeks, and no assignments were submitted after week 3. Only 7 assignments were submitted during the semester, making up 8% of participation. Summer ‘18 did not include any assignments.
[41] 6.3.3. LMS Page Access Only.Participation was also counted for participants who accessed the LMS site, even if they did not engage with the group’s other activities (Figure 5). By accessing the page, participants could watch the video lessons and browse the references. In Summer '17, when the group was structured around the video lessons and assignments, participants accessed the LMS page 6 times (10% of participation). This number skyrocketed in Autumn 2017 to 69% of the total participation, and remained high in Spring '18 (37% of participation). In Summer '18, however, everybody who accessed the LMS page also actively participated by either posting to the discussion board or charting writing progress. Over time, then, the various features of the group became more integrated for users.
[42] 6.3.4. Writing Progress, Summer '18.An additional metric, which was only tracked during the Summer '18 group, was participants’ reported daily and weekly writing progress in a shared and public embedded Excel file on the LMS “course” shell for the group, as shown in Figure 6. Reported writing progress accounted for just under half (44%) of total participation in the group (Figure 5).
[43] During the first week of the semester, the largest number of participants engaged with this activity. 17 unique people posted 73 unique entries (Figure 6). Engagement decreased by approximately half in week 2, (8 unique participants made 40 unique entries), and remained fairly consistent for the subsequent weeks, with an average of 5 unique participants posting an average of 29 unique entries a week during weeks 2-9. With most participants writing more than 1 entry a week, a sum of 306 unique entries were made by 60 unique people over the 9-week semester. |
10. AppendicesAppendix A: The Seven-Day Two-Step Asynchronous Consultation (appendixa.pdf) Appendix B: The Five-Day Two-Step Asynchronous Consultation (appendixb.pdf) Appendix C: The Drop-Off Consultation (appendixc.pdf) Appendix D: Summer 2017 Writing Group (appendixd.pdf) Appendix E: Summer 2018 Writing Group (appendixe.pdf) |