Enhancing Tennis Serve Scoring Efficiency: An AI Deep Learning Approach.

Jing Wei Liu

doi:10.9781/ijimai.2024.07.003

Authors

Jing Wei Liu National Taiwan University of Sport

DOI:

https://doi.org/10.9781/ijimai.2024.07.003

Keywords:

Deep Learning, Internet of things, Markerless Motion Capture, Notational Analysis, Tennis Techniques And Tactics, Video Analysis

Supporting Agencies

Funding Author gratefully acknowledges the sponsorship of the National Science and Technology Council in Taiwan, ROC, under the project NSTC 112-2410-H-028-002-.

Abstract

The playing field of a tennis competition is a dynamic and complex formative environment given the following preliminary knowledge: (a) the basic technical, tactical, situational, and special types of shots used by the opponent; (b) the hitting area of the tennis player; (c) the place of service; (d) the ball drop position; and (d) batting efficiency and other related information that may improve the chances of victory. In this study, we propose an AI classification model for tennis serve scores. Using a deep learning algorithm, the model automatically tracks and classifies the serve scores of professional tennis players from video data. We first defined the players’ techniques, volleys, and placements of strokes and serves. Subsequently, we defined the referee's tennis terms and the voice in deciding on a serve score. Finally, we developed a deep learning model to automatically classify the serving position, landing position, and use of tennis techniques. The methodology was applied in the context of 10 matches played by Roger Federer and Rafael Nadal. The proposed deep learning algorithm achieved a 98.27% accuracy in the automatic classification of serve scores, revealing that Nadal outscored Federer by 2.1% in terms of serve-scoring efficiency. These results are expected to facilitate the automatic comparison and classification of shots in future studies, enabling coaches to adjust tactics in a timely manner and thereby improve the chances of winning.

Downloads

Download data is not yet available.

References

J. Del Corral, “Competitive balance and match uncertainty in grand-slam tennis,” Journal of Sports Economics, vol. 10, no. 6, pp. 563–581, 2009.

D. Whitson and J. Horne, “Underestimated costs and overestimated benefits? Comparing the outcomes of sports mega-events in Canada and Japan,” The Sociological Review, vol. 54, no. 2_suppl, pp. 73–89, 2006.

D. Maynes-Aminzade, R. Pausch and S. Seitz, "Techniques for interactive audience participation," Proceedings of the Fourth IEEE International Conference on Multimodal Interfaces, Pittsburgh, PA, USA, 2002, pp. 15- 20, doi: 10.1109/ICMI.2002.1166962.

G. Nhamo, K. Dube, and D. Chikodzi, “Implications of COVID-19 on Gaming, Leisure and Entertainment Industry,” in Counting the Cost of COVID-19 on the Global Tourism Industry, Springer, 2020, doi: 10.1007/978-3-030-56231-1_12.

S. Keshkar, G. Dickson, A. Ahonen, K. Swart, F. Addesa, A. Epstein, A., et al., “The effects of coronavirus pandemic on the sports industry: an update,” Annals of Applied Sports Science. vol. 9, no. 1, 2021.

R. Rein and D. Memmert, “Big data and tactical analysis in elite soccer: future challenges and opportunities for sports science,” SpringerPlus, vol. 5, pp. 1410, 2016, doi: 10.1186/s40064-016-3108-2.

D. He, L. Li, and L. An, “Study on sports volleyball tracking technology based on image processing and 3D space matching,” IEEE Access, vol. 8, pp. 94258–94267, 2020.

Z. Li, X. Ye, and H. Liang, “Sports video analysis system based on dynamic image analysis,” Neural Computing and Applications, vol. 35, no. 6, pp. 4409–4420, 2022.

B. Meng, X. Liu, and X. Wang, “Human action recognition based on quaternion spatial-temporal convolutional neural network and LSTM in RGB videos,” Multimedia Tools and Applications, vol. 77, pp.26901–26918, 2018.

G. Fele, and G. M. Campagnolo, “Expertise and the work of football match analysts in TV sport broadcasts,” Discourse Studies, vol. 23, no. 5, pp. 616–635, 2021.

G. Thonhauser and M. Wetzels, “Emotional sharing in football audiences,” Journal of the Philosophy of Sport, vol. 46, no. 2, pp. 224–243, 2019.

I. Errekagorri, J. Castellano, I. Echeazarra, and C. Lago-Peñas, “The effects of the video assistant referee system (VAR) on the playing time, technical-tactical and physical performance in elite soccer,” International Journal of Performance Analysis in Sport, vol. 20, no. 5, pp. 808–817, 2020.

C. Lago-Peñas, M. Gómez, and R. Pollard, “The effect of the video assistant referee on referee’s decisions in the Spanish LaLiga,” International Journal of Sports Science & Coaching, vol. 16, no. 3, pp. 824–829, 2020.

I. Tamir and M. Bar-eli, “The Moral Gatekeeper: Soccer and Technology, the Case of Video Assistant Referee (VAR),” Frontiers in Psychology, vol. 11, pp. 613469, 2021, doi: 10.3389/fpsyg.2020.613469.

K. Rangasamy, M. A. As'ari, N. A. Rahmad, N. F. Ghazali, and S. Ismail, “Deep learning in sport video analysis: a review,” Telkomnika, vol. 18, no. 4, pp. 1926–1933, 2020.

Y. R. Qiu, “Construct a model of tennis players’ competition,” Master Thesis, National Taiwan University of Sport, Department of Recreational & Graduate Institute of Recreational Sport Management, Taichung, Taiwan, 2020.

C. W. Chang and Y. R. Qiu, “Constructing a Gaming Model for Professional Tennis Players Using the C5.0 Algorithm,” Applied Sciences, vol. 12, no. 16, pp. 1–13, https://doi.org/10.3390/app12168222

L. -Y. Duan, M. Xu, and Q. Tian, “Semantic shot classification in sports video,” in Storage and Retrieval for Media Databases 2003, 2003, pp. 300–313.

B. Dang, A. Tran, T. Dinh, and T. Dinh, “A real time player tracking system for broadcast tennis video,” Lecture Notes in Computer Science, vol. 5991, pp. 105–113, 2010.

D. Connaghan, P. Kelly, N. E. O’Connor, M. Gaffney, M. Walsh, and C. O’Mathuna, “Multi-sensor classification of tennis strokes,” in SENSORS, 2011 IEEE, pp. 1437–1440, 2011.

C. J. Raymond, T. J. Madar, and A. H. Montoye, “Accuracy of the Babolat Pop sensor for assessment of tennis strokes in structured and match play settings,” Journal of Sport and Human Performance, vol. 7, no. 1, 2019.

W. Pei, J. Wang, X. Xu, Z. Wu, and X. Du, “An embedded 6-axis sensor based recognition for tennis stroke,” 2017 IEEE International Conference on Consumer Electronics (ICCE), pp. 55–58, 2017.

M. Sharma, R. Srivastava, A. Anand, D. Prakash, and L. Kaligounder, “Wearable motion sensor based phasic analysis of tennis serve for performance feedback,” 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5945–5949, 2017.

N. Myers, W. Kibler, A. Axtell, and T. Uhl, “The Sony Smart Tennis Sensor accurately measures external workload in junior tennis players,” International Journal of Sports Science & Coaching, vol. 14, no. 1, pp. 24-31, 2019, doi: https://doi.org/10.1177/1747954118805278

C. J. Ebner and R. D. Findling, “Tennis Stroke Classification: Comparing Wrist and Racket as IMU Sensor Position,” in Proceedings of the 17th International Conference on Advances in Mobile Computing & Multimedia, pp. 74-83, 2019.

T. Perri, M. Reid, A. Murphy, K. Howle, and R. Duffield, “Validating an algorithm from a trunk-mounted wearable sensor for detecting stroke events in tennis,” Journal of Sports Sciences, vol. 40, no. 10, pp. 1168–1174, 2022.

R. J. Lake, Routledge Handbook of Tennis, Historical changes in playing styles and behavioural etiquette in tennis, England: Taylor & Francis, 2019.

R. Voeikov, N. Falaleev, and R. Baikulov, “TTNet: real-time temporal and spatial video analysis of table tennis,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 884–885, 2020.

S. Xu, L. Liang, and C. Ji, “Gesture recognition for human–machine interaction in table tennis video based on deep semantic understanding,” Signal Processing: Image Communication, vol. 81, p. 115688, 2020.

F. Qiao, “Application of deep learning in automatic detection of technical and tactical indicators of table tennis,” PLoS ONE, vol. 16, no. 3, pp. 0245259, 2021.

V. Reno, N. Mosca, R. Marani, M. Nitti, T. D'Orazio, and E. Stella, “Convolutional neural networks based ball detection in tennis games,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 1758–1764, 2018.

A. Ganser, B. Hollaus, and S. Stabinger, “Classification of tennis shots with a neural network approach,” Sensors, vol. 21, no. 17, pp. 5703, 2021.

A. Bastanfard, and D. Amirkhani, “Improving the Accuracy of the Annotation Algorithm in Pattern-Based Tennis Game Video,” in 2021 29th Iranian Conference on Electrical Engineering (ICEE), pp. 493–497, 2021.

H. Huang, “Object extraction of tennis video based on deep learning,” Wireless Communications and Mobile Computing, vol. 2022, article ID 5402410, 2022.

B. Ning, and L. Na, “Deep spatial/temporal-level feature engineering for tennis-based action recognition,” Future Generation Computer Systems, vol. 125, pp. 188–193, 2021.

H. Li, H. Guo, and H. Huang, “Analytical model of action fusion in sports tennis teaching by convolutional neural networks,” Computational Intelligence and Neuroscience, vol. 2022, 2022.

TennisCT, “THE TENNIS STROKES,” Accessed: May 4, 2023. [Online]. Available: https://www.tennisct.com/strokes

My Tennis HQ, “Tennis Volleys: Definition, Steps & Tips,” Accessed: May 4, 2023. [Online]. Available: https://mytennishq.com/