Journal of Cognitive Human-Computer Interaction JCHCI 2771-1463 2771-1471 10.54216/JCHCI https://www.americaspg.com/journals/show/1102 2021 2021 Rajalakshmi Engineering College, Panimalar Institute of Technology, India Shanthalakshmi Shanthalakshmi Rajalakshmi Engineering College, Panimalar Institute of Technology, India Susmita .. Rajalakshmi Engineering College, Panimalar Institute of Technology, India LincyJemina. S. Rajalakshmi Engineering College, Panimalar Institute of Technology, India Raashmi. P. Rajalakshmi Engineering College, Panimalar Institute of Technology, India Mannuru Shalin Rajalakshmi Engineering College, Panimalar Institute of Technology, India Jananeee. V. This paper focuses on providing a solution to the direct conversion of speech to shorthand. Since shorthand is not understood by many but is used for writing quick transcripts, a product is developed that converts the speech to its appropriate Gregg shorthand. A website that will be used as a front end, will use a speech-to-text API to record the speech in real-time. The converted text will then be fed into a text-to-image retrieval model that derives its corresponding Gregg shorthand for the text. The text will then be displayed to the user in real-time. By achieving this, the model reduces the need to depend upon stenographers for transcribing scripts. The resulting model achieves a good result. 2022 2022 36 41 10.54216/JCHCI.030105 https://www.americaspg.com/articleinfo/25/show/1102