Journal of Cognitive Human-Computer Interaction JCHCI 2771-1463 2771-1471 10.54216/JCHCI https://www.americaspg.com/journals/show/1102 2021 2021 Rajalakshmi Engineering College, Panimalar Institute of Technology,India Shanthalakshmi M Rajalakshmi Engineering College, Panimalar Institute of Technology,India Susmita .. Rajalakshmi Engineering College, Panimalar Institute of Technology,India LincyJemina S Rajalakshmi Engineering College, Panimalar Institute of Technology,India Raashmi P Rajalakshmi Engineering College, Panimalar Institute of Technology,India Mannuru Shalin Rajalakshmi Engineering College, Panimalar Institute of Technology,India jananeee jananeee.v This paper focuses on providing a solution to the direct conversion of speech to shorthand. Since shorthand is not understood by many but is used for writing quick transcripts, a product is developed that converts the speech to its appropriate Gregg shorthand. A website that will be used as a front end, will use a speech-to-text API to record the speech in real-time. The converted text will then be fed into a text-to-image retrieval model that derives its corresponding Gregg shorthand for the text. The text will then be displayed to the user in real-time. By achieving this, the model reduces the need to depend upon stenographers for transcribing scripts. The resulting model achieves a good result. 2022 2022 36 41 10.54216/JCHCI.030105 https://www.americaspg.com/articleinfo/25/show/1102