Galoitica: Journal of Mathematical Structures and Applications GJMSA 2834-5568 10.54216/GJSMA https://www.americaspg.com/journals/show/2142 2022 2022 The Applications of Digital Signal Processing Techniques for Enhancing the Performance of High Speed Optical Communication Systems Faculty of Informatics Engineering , Albaath University, Syria Sandy Montajab Hazzouri This paper presents Improving performance of 112 Gbits optical coherent communications systems using digital signal processing techniques to compensate linear impairments that are exposed to the signal during its propagation in optical fiber. In this paper, different multi-level modulation formats (DP-QPSK, DP 8PSK, DP- 16PSK and DP-16-QAM) were compared for the same data rate at different distances from the transmitter without amplification. the comparison was done by measuring bit error rate value. We used digital signal processing techniques for linear effects compensation. Where chromatic dispersion was compensated using a simple digital filter, and Polarization mod dispersion was realized by applying the constant-modulus algorithm (CMA). The phase and frequency mismatch between the transmitter and the local oscillator in the receiver was compensated using the modified Viterbi-Viterbi algorithm. We used the Optical simulator Opti-system , which was linked with MATLAB R2011 in order to implementation DSP algorithms and analyze obtained results. 2023 2023 16 28 10.54216/GJMSA.080202 https://www.americaspg.com/articleinfo/33/show/2142