Volume 3 • Issue 1 • PP: 36-41 • 2022
An Approach for Devising Stenography Application Using Cross Modal Attention
Open Access & Copyright
© 2022 The Author(s). Published by ASPG. This article is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
View PDF Abstract
This paper focuses on providing a solution to the direct conversion of speech to shorthand. Since shorthand is not understood by many but is used for writing quick transcripts, a product is developed that converts the speech to its appropriate Gregg shorthand. A website that will be used as a front end, will use a speech-to-text API to record the speech in real-time. The converted text will then be fed into a text-to-image retrieval model that derives its corresponding Gregg shorthand for the text. The text will then be displayed to the user in real-time. By achieving this, the model reduces the need to depend upon stenographers for transcribing scripts. The resulting model achieves a good result.
Keywords
References
[1] DionisA. Padilla, Nicole Kim U. Vitug and Julius Benito S. Marquez., “Deep learning approach in Gregg shorthand word to English word conversion” (2020)
[2] ZhongJi and Kexin Chen, “Step-Wise Hierarchical Alignment Network for Image-Text Matching ’’ (2021)
[3] Xing Xu, Tan Wang, Yang Yang, Lin Zuo, FuminShen, and Heng Tao Shen, “Cross Model Attention with Semantic Consistence for Image Text Matching’’ (2020)
[4] Neha Sharma andShipraSardana, “A Real-Time Speech to Text Conversion system using Bidirectional Kalman Filter Matlab’’(2016)
[5] Kuang-Huei Lee, Xi Chen, Gang Hua, Houdong Hu and Xiaodong He, ”Stacked Cross Attention for Image-Text Matching” (2018)
[6] K. R. Abhinand and H. K. AnasuyaDevi,“An Approach for Generating Pattern-Based Shorthand Using Speech-to-Text Conversion and Machine Learning ’’ (2013)
[7] R.Rajasekaran , K.Ramar, “Handwritten Gregg Shorthand Recognition’’ in International Journal of Computer Applications (2012)
[8] Zihao Wang , Xihui Liu , Hongsheng Li , Lu Sheng , JunjieYan , Xiaogang Wang and Jing Shao, “CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrieval’’ in IEEE/CVF International Conference on Computer Vision (ICCV) (2019)
[9] StanislavFrolov , Tobias Hinz , Federico Raue , J¨ornHees and Andreas Dengel, “Adversarial Text-to- Image Synthesis: A Review” (Neural Networks Journal,2021)
[10] SaifuddinHitawala, “Comparative Study on Generative Adversarial Networks’’(2018)
[11] Cheng Wang, Haojin Yang, Christian Bartz and ChristophMeinel, “Image Captioning with Deep Bidirectional LSTMs’’ (2016)
[12] Daniela Onita , Adriana Birlutiu and Liviu P. Dinu, “Towards Mapping Images to Text Using Deep- Learning Architectures’’ (2020)
[13] Christine Dewi , Rung-Ching Chen , Yan-Ting Liu and Hui Yu , " Various Generative Adversarial Networks Model for Synthetic Prohibitory Sign Image Generation'' , (2021)
[14] Hao Wu , Jiayuan Mao , Yufeng Zhang, Yuning Jiang, Lei Li, Weiwei Sun, and Wei-Ying Ma., "Unified Visual-Semantic Embeddings: Bridging Vision and Language with Structured Meaning Representations'' , (2019)
[15] Scott Reed, ZeynepAkata, Xinchen Yan, LajanugenLogeswaran , BerntSchiele and Honglak Lee, "Generative Adversarial Text to Image Synthesis'' , (2016)
Cite This Article
Choose your preferred format
Publisher's Note
The statements, opinions, and data presented in this article are solely those of the author(s) and do not necessarily represent those of ASPG, the journal, or its editors. ASPG and the editors disclaim responsibility for any harm arising from the use of any ideas, methods, instructions, or products described in this article, to the fullest extent permitted by applicable law.