Strategies for Reading and Writing.

Speech to Text: Scaffolding Writing Tasks

marker.

Overview

“If you can say it, you can write it.” Speech to Text (STT) gives us a way to quickly transcribe our thoughts, taking the words we say out loud and transforming them into written text. Speech to text apps and software allow us to record ideas off the top of our heads; the words or sentences generated will generally require some review and editing before they become a usable paragraph. STT options are built into platforms (e.g., Google tools) and devices (e.g. using Siri on iOS or Google Assistant/Bixby on Android devices).


This Speech to Text: Scaffolding A Writing Task strategy gives learners a way to develop a report or essay, using technology as a scaffold for drafting ideas. This strategy is helpful for learners who find it challenging to generate writing as well as those who are developing language skills.  Using speech to text to write also helps learners with memory and organization. For those who forget what they wanted to write as they generate written words, speech to text makes it easier to capture thoughts quickly.  Speech to text is not appropriate for everyone because it can be frustrating for some learners. For this reason, it’s good to give learners practice with using STT so they can make choices about whether they find it useful or not.  See the videos below to learn more about who it can help and how you can use it.

play button.

Videos & Examples

Speech to Text (STT) as an Instructional Support (2:03)

In this video, we describe what factors to consider if you’re using STT in the classroom. We share information on who finds STT helpful and who finds it to be a hindrance.

 

Tips for Using Speech-to-Text in the Classroom (2:14)

There are some things you can do to make STT more accurate and easy to use for students. This video goes over tips of using STT effectively. This Tip Sheet: Introducing  Speech to Text (STT) in the Classroom lists some key considerations.

STT Demo: Using STT as a Instructional Scaffold for Writing (3:06)

This video demonstrates how to break a larger writing assignment into prompts and use Google Doc’s STT feature to begin dictating/writing.

How can you integrate this strategy in the classroom?

STT can be used as a scaffold for various types of writing tasks. Learners can use STT to brainstorm ideas, build out ideas from an outline, and generate bits of text to use in a larger piece of writing.  In the classroom, you can use it to have learners generate informal reflections (e.g., daily journaling) or sentences/passages they will use in a written product (e.g., an essay or report).

The following illustrates how STT can be used as part of a specific lesson that results in a writing assignment (writing an essay/report). This is one example of how STT can be used for a writing task. The table illustrates how STT can be used to reduce barriers and address learner variability in alignment with the steps of the UDL Design Cycle.  The strategy can be used with other types of writing tasks/assignments (like outlining, journaling, brainstorming).

Goal for this lessonDevelop an essay or report (on any topic)
Potential barriers to reaching this goal
  • Content is complex or challenging
  • Expressing what they know about the content is daunting
  • Students may be unsure what to address in essay
  • Students may be unsure of expectations for structuring an essay
  • Unsure where and how to begin writing an essay
Learner variability factors

Strengths: Some students may like to speak/talk

Preferences: 

  • Some students may prefer speaking to writing  
  • Some students may prefer typing

Support Needs: 

  • Some students can benefit from support for short term memory; STT allows them to get words onto a document immediately without spending time writing/typing.
  • Some students may have speech impediments or challenges articulating words - STT may not be a good fit here.
AssessmentEvaluate the text that students generate with STT and provide formative feedback as they build an essay.  This gives the student an opportunity to build an essay with relevant instructional feedback for their needs.
Methods
  1. Provide a series of short prompts for the student to respond to in order to get them started in generating text.  The prompts can be questions. (See the video Tips for Using Speech-to-Text in the Classroom for an example.)
  2. After the student generates text via STT, encourage them to review and edit any mistakes in the text.
  3. Review the text and provide your feedback.  You can ask the student to say more or provide follow up prompts.
  4. Encourage the student to put the bits of text they have generated into an essay format as a starting point for developing their essay/report further.
MaterialsGoogle Doc (on a Chromebook, laptop, or mobile device)

How does this strategy support multilingual learners and students with disabilities?

This strategy aligns to the Foundations and Frameworks for supporting Multilingual Learners (MLLs) and Students with Disabilities in the following ways:

icon.

Content and Language Development

Support for language production: 

  • STT can allow some learners to express their thoughts more quickly (orally). For those who may feel inhibited by writing or typing, STT lets them “say what they want to write”. 
  • It is important to consider that some students may find STT frustrating and prefer writing. Check out the video Speech to Text (STT) as an Instructional Support for more information on who STT can be helpful for and who may find it frustrating.
  • For learners who struggle with initiating writing, STT can provide a jump start, by letting them speak about the topic. It can reduce anxiety for students by removing the formality of writing and allowing them to capture ideas.
  • Provide scaffolding using prompts or an outline that can help students generate text towards a larger writing goal. See the STT Demo video for an example.

Opportunities for Feedback and Practice

  • By speaking their thoughts out loud, learners can generate text in smaller chunks. This gives learners the opportunity to build on ideas and break down a large writing task into component pieces. 
  • Teachers can provide scaffolds to go with STT. For example, if your learners have to write an essay or report, you can provide support by providing prompts or questions that they can “talk” about/respond to.  Using STT, learners can generate chunks of text in their responses to the prompts that can be pulled into writing assignments.
  •  Teachers can add interaction and feedback to the process, by listening to audio clips and asking follow up questions or giving learning centered feedback on how to expand on what the learners have said/written.  In this way, teachers can provide incremental and formative feedback and use the opportunity to interact and support language development while students are working on an assignment.

icon.

Universal Design for Learning

Incorporating speech to text into the writing process aligns with the UDL Principle - Multiple Means of Action & Expression:

Action & Expression Guidelines

UDL Guideline 4: Physical Action

  • Checkpoint 4.2:  Optimize access to tools and assistive technologies:

Speech to text, a built-in feature on mobile devices and laptops, puts this  classic assistive technology feature at our fingertips, making it an easy tool for learners to use when they need it. STT can be accessed by anyone on their device(s) and does not require specialized or costly purchases.

UDL Guideline 5: Expression and Communication

  • Checkpoint 5.2: Use multiple tools for construction and communication
  • Checkpoint 5.3: Build fluencies with graduated levels of support for practice and performance

Speech to text provides scaffold for the writing process  that learners can use as and when they need. This tool:

  • converts spoken word to text, which helps us put down ideas quickly from our short term memory. This can help learners who require time to write/type out their ideas and may forget what their key points were while they write. It can also help learners who need support with spelling words. Speech to text allows us to quickly get thoughts down.
  • provides opportunities for learners to generate and play with ideas as they write. If they say something and decide not to use it or to expand on it, they can easily delete or edit what they said.

UDL Guideline 6: Executive Functions

  • Checkpoint 6.2: Support planning and strategy development
  • Checkpoint 6.3 Facilitate managing information and resources:

By allowing learners to capture thoughts as they arise, speech to text can help learners brainstorm and generate ideas.  With STT, thoughts can quickly be captured in writing and learners can go back and organize/expand on thoughts. This supports executive function processes that are required for writing tasks.

icon.

Multilingual Learners and Students with Disabilities

This strategy supports short term/working memory and processing and provides a scaffold for writing tasks for multilingual learners and students with disabilities by doing the following:

  • Breaks down the cognitive tasks/demands involved in producing written language 
  • Chunks information into small, focused segments/ tasks.
  • Can be used with outlines/graphic organizers. Learners can “talk out loud” and add words to prompts provided by the teacher
  • Provides visual support for auditory information 

STT is not for everyone. For some learners , it can be frustrating to use, for example:

  •  Some learners simply prefer typing and can generate text more quickly and accurately by typing instead of speaking. 
  • STT can also be frustrating for learners who have speech impediments or whose articulation of words results in incorrect transcription.  

To ensure that STT is a supportive choice for your LLs and SWDs, we recommend having them try it and reflect on whether they find it useful (The Tip Sheet: Introducing  Speech to Text (STT) in the Classroom document for more information.)

icon.

Culturally Relevant Practices and Asset-Based Pedagogies

Some learners come from cultures that value oral expression. For example, “talk story” is a free-flowing form of communication used to share information in Hawai‘i (Kanaipuni, Ledward, & Jensen, 2010).   STT can allow these learners to use a more flee flowing form of expression that may more natural and familiar to them and to make the connection that writing can be based on thoughts they express.

Additional Resources

 The Benefits of Speech-to-Text Technology in All Classrooms ( 2021)

KQED’s Mind/Shift series presents short articles on educational innovations and practices that can support students. In this short piece, Caroline Smith describes how a resource specialist teacher in California and an elementary teacher in Oregon have used STT to help students record their thoughts and used the technology as part of the writing process.

 

Speech Recognition as Assistive Technology (AT) for Writing (2020)

Daniel Cochrane and Kelly Key have written this practical guide for teachers seeking to incorporate STT into their classroom. They detail a step-by-step process for planning, selecting technology, teaching how to use Speech Recognition (SR), and assessing the use of this tool.

Research & References

Highlights from Research on STT:

Specific benefits of STT for ELs and students with learning disabilities identified in research studies (Gillespie & Graham, 2014; Pennington et al., 2018) include:

  • Some students generated more text with ease (De La Paz, 1999; Graham, 1999) and generated lengthier passages (McCollum et al., 2014)
  • Students were able to use more extensively developed oral vocabularies (Higgins and Raskind, 1995). 
  • Written passages generated with speech recognition were of higher quality than handwritten passages (MacArthur and Cavalier, 2004)
  • Students improved their spelling accuracy (Raskind & Higgins, 1999)
  • Struggling writers improved confidence in their ability to write (Toll, 2014)

De La Paz, S. (1999). Composing via dictation and speech recognition systems: Compensatory technology for students with learning disabilities. Learning Disabilities Quarterly, 22(3), 173–182. http:// doi.org/10.2307/1511284

 

Gillespie, A., & Graham, S. (2014). A meta-analysis of writing interventions for students with learning disabilities. Exceptional Children, 80(4), 454–473. http://doi.org/10.1177/0014402914527238

 

Graham, S. (1999). The role of text production skills in writing development: A special issue. Learning Disability Quarterly, 22(2), 75–77. https://doi.org/10.2307/1511267

 

Higgins, E. L., & Raskind, M. H. (1995). Compensatory effectiveness of speech recognition on the written composition performance of postsecondary students with learning disabilities. Learning Disability Quarterly, 18(2), 159–174. http://doi.org/10.2307/1511202 

 

Kana’iaupuni, S.B., Ledward,B., & Jensen, U. (2010). Culture-based education and its relationship to student outcomes. Honolulu: Kamehameha Schools, Research & Evaluation.

 

MacArthur, C. A., & Cavalier, A. R. (2004). Dictation and speech recognition technology as test accommodation. Exceptional Children, 71(1), 43–58. http://doi/org/10.1177/001440290407100103

 

McCollum, D., Nation, S., & Gunn, S. (2014). The effects of speech-to-text software application on written expression for students with various disabilities. National Forum of Special Education Journal, 25(1), 1–13. 

 

Ok, M.W., Rao, K., Pennington, J, & Ulloa, P. (2022). Speech recognition technology for writing: Usage patterns and perceptions of students with high incidence disabilities. Journal of Special Education Technology. 37(2), 191-202. https://doi.org/10.1177/0162643420979929

 

Pennington, J., Ok, M. W., & Rao, K. (2018). Beyond the keyboard: A review of speech recognition technology for supporting writing in schools. International Journal for Educational Media and Technology, 12(2), 47–55.

 

Raskind, M.H., & Higgins, E.L. (1999). Speaking to read: The effects of speech recognition technology on the reading and spelling performance of children with learning disabilities. Annals of Dyslexia, 49(1), 251–281. http://doi/org/10.1007/s11881-999-0026-9

 

Toll, K. (2014). The role of speech recognition technology in fostering cognitive engagement in students [Master’s thesis]. University of Calgary. https://prism.ucalgary.ca/bitstream/11023/ 1911/2/ucalgary_2014_Kendal_Toll.pdf