Adnan Rachmat Anom Besari

Adnan Rachmat Anom Besari, Ph.D.

Research Theme:
Multi-scopic Cyber-physical-social System based on Embodied Integration for Interaction
Modeling and Knowledge Building

Abstract:
The number of bedridden elderly individuals has increased due to the aging population in the world. Many countries strive to solve this issue through health promotion programs. One effective method of health promotion to maintain the health and well-being of elderly individuals is daily exercise. Nevertheless, elderly individuals often lack the means to assess the efficacy of their daily exercise routines. This problem results in low motivation and hinders their ability to enhance their health promotion efforts. With current technological advancements, it is possible to quantitatively measure the effectiveness of daily exercise to enhance motivation and improve health outcomes. In Society 5.0, researchers have extensively proposed cyber-physical-social systems (CPSS) for health promotion. In cyberspace, CPSS seamlessly connects physical space at the microscopic level and social space at the macroscopic level. However, previous methods rarely focus on the coupling mechanism of human physical and cognitive abilities in CPSS. As a result, connecting microscopic and macroscopic levels presents a challenge due to the lack of CPSS designs. The mesoscopic level is expected to serve as an intermediary layer to effectively bridge the gap between these two levels. In discussing the mesoscopic level, I focus on the perceiving-acting cycle to model the interaction and build knowledge in CPSS. This coupling mechanism describes how humans continuously engage with their surroundings in embodied integration. In essence, the embodied integration underscores the reflective interconnection between cognitive processes and the perception of the physical body and its interactions. Incorporating embodied sensing, perception, and cognition into multi-scopic CPSS is vital to addressing the lack of integration and enhancing the effectiveness of health promotion.

Figure: Multi-scopic CPSS based on embodied integration.

This study proposes the multi-scopic CPSS by embodied integration, emphasizing the concept of the perceiving-acting cycle. At the microscopic level, I focus on developing an embodied sensing based on hand skeleton data to gain a detailed understanding of hand motion with posture. The mesoscopic level involves embodied perception rooted in hand-eye coordination, enabling the analysis of hand action based on hand-object interaction and visual attention. At the macroscopic level, I incorporate embodied cognition based on a knowledge graph to assess cognitive abilities relevant to human behavior. To evaluate the effectiveness of our proposed system, we conduct assessments in the chopsticks manipulation test (CMT) and the block design test (BDT), which offer valuable insights into the progress and capabilities of individuals undergoing health promotion. Finally, the micro-meso-macro loop for embodied integration is introduced by applying the bottom-up and top-down approaches for hand activity. The experimental results of the multi-scopic CPSS based on embodied integration have been thoroughly analyzed from microscopic, mesoscopic, and macroscopic perspectives. In conclusion, the micro-meso-macro loop indicates that interaction modeling and knowledge building can improve the effectiveness of strategies for health promotion. This study also highlights that the perceiving-acting cycle enhances the efficiency of health promotion through context modeling. Finally, in the practical application, this approach enables individuals to access and monitor their well-being, significantly facilitating their ability to make informed decisions to improve their quality of life. The potential for this extension to encompass more comprehensive applications in future work holds promise for enhancing the multi-scopic CPSS adaptability of health promotion programs.

Keywords:
perceiving-acting cycle, health promotion, hand-eye coordination, cognitive assessment, and knowledge graph

Publication List in Moonshot Project (2020-2025):

Journal Papers

  1. A. R. A. Besari, A. A. Saputra, W. H. Chin, Kurnianingsih, and N. Kubota, “Joint Angle Estimation With Visual Attention for Rehabilitation Support: A Case Study of the Chopsticks Manipulation Test,” IEEE Access, vol. 10, pp. 91316–91331, 2022, doi: 10.1109/ACCESS.2022.3201894.
  2. A. R. A. Besari, A. A. Saputra, T. Obo, Kurnianingsih, and N. Kubota, “Multiscopic CPSS for Independent Block-Design Test Based on Hand–Object Interaction Recognition With Visual Attention,” IEEE Access, vol. 11, pp. 58188–58208, 2023, doi: 10.1109/ACCESS.2023.3282876.
  3. A. R. A. Besari, A. A. Saputra, W. H. Chin, K. Kurnianingsih, and N. Kubota, “Hand–Object Interaction Recognition Based on Visual Attention Using Multiscopic Cyber-Physical-Social System,” International Journal of Advances in Intelligent Informatics, vol. 9, no. 2, pp. 187–205, Jul. 2023, doi:10.26555/ijain.v9i2.901.
  4. A. R. A. Besari, F. Ardilla, A. A. Saputra, Kurnianingsih, T. Obo, and N. Kubota, “Egocentric Behavior Analysis Based on Object Relationship Extraction with Graph Transfer Learning for Cognitive Rehabilitation Support,” Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 29, no. 1, Jan. 20, 2025, doi:10.20965/jaciii.2025.p0012.

Conference Papers

  1. A. R. A. Besari, W. H. Chin, N. Kubota, and Kurnianingsih, “Ecological Approach for Object Relationship Extraction in Elderly Care Robot,” in Proceedings of the 21st International Conference on Research and Education in Mechatronics (REM), Cracow, Poland, Dec. 2020, pp. 1–6, doi: 10.1109/REM49740.2020.9313877.
  2. M. Yani, A. R. A. Besari, N. Yamada, and N. Kubota, “Ecological-Inspired System Design for Safety Manipulation Strategy in Home-care Robot,” 2020 International Symposium on Community-centric Systems (CcS), Tokyo, Japan, 2020, pp. 1-6, doi: 10.1109/CcS49175.2020.9231354.
  1. A. R. A. Besari, A. A. Saputra, W. H. Chin, N. Kubota, and Kurnianingsih, “Feature-based Egocentric Grasp Pose Classification for Expanding Human-Object Interactions,” in Proceedings of the 30th IEEE International Symposium on Industrial Electronics (ISIE), Kyoto, Japan, Jun. 2021, pp. 1–6, doi: 10.1109/ISIE45552.2021.9576369.
  2. A. R. A. Besari, A. A. Saputra, W. H. Chin, N. Kubota, and Kurnianingsih, “Hand-Object Interaction Detection Based on Visual Attention for Independent Rehabilitation Support,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN), Padua, Italy, Jul. 2022, pp. 1–6, doi: 10.1109/IJCNN55064.2022.9892903.
  3. A. R. A. Besari, A. A. Saputra, W. H. Chin, K. Kurnianingsih, and N. Kubota, “Hand–Object Interaction Recognition Based on Visual Attention Using Multiscopic Cyber-Physical-Social System,” in Proceedings of the 4th International Conference on Innovation in Science and Technology (ICIST), Semarang, Indonesia, Dec. 2022.
  4. F. Ardilla, A. A. Saputra, A. R. A. Besari, D. Naoki, O. Kohei, and T. Obo, “Topological Twin for Mobility Support Robots,” in 2022 IEEE 8th World Forum on Internet of Things (WF-IoT), Oct. 2022, pp. 1–6, doi: 10.1109/WF-IoT54382.2022.10152223.
  5. A. A. Saputra, A. R. A. Besari, and N. Kubota, “Human Joint Skeleton Tracking Using Multiple Kinect Azure,” 2022 International Electronics Symposium (IES), Surabaya, Indonesia, 2022, pp. 430-435, doi: 10.1109/IES55876.2022.9888532.
  6. A. A. Saputra, C. W. Hong, M. Yani, F. Ardilla, A. R. A. Besari, and Y. Toda, “Topological based Environmental Reconstruction for Efficient Multi-Level Control of Robot Locomotion,” 2022 International Electronics Symposium (IES), Surabaya, Indonesia, 2022, pp. 491-496, doi: 10.1109/IES55876.2022.9888288.
  7. A. R. A. Besari, A. A. Saputra, T. Obo, Kurnianingsih, and N. Kubota, “Integrated Multiscopic CPSS for Physical and Cognitive Measurement in an Independent Block-Design Test,” in Proceedings of the International Conference on Machine Learning and Cybernetics (ICMLC), Adelaide, Australia, Jul. 2023, pp. 1–6, doi: 10.1109/ICMLC58545.2023.10327972.
  8. Y. Omori, Y. Morio, M. Omori, S. Sekine, A. R. A. Besari, T. Obo, N. Kubota, and J. Yamamoto, “Possibility of acquiring new movements in older people: measurement of non-dominant hand chopstick manipulation and rehabilitation,” Intelligent Systems Symposium (CD-ROM), vol. 31, pp. 3–4, 2023.
  9. A. R. A. Besari, A. A. Saputra, T. Obo, Kurnianingsih, and N. Kubota, “Expanding the Integration of Multiscopic Cyber-Physical-Social System with Physical Sensors in Block-Design Test,” in Proceedings of the 16th IEEE/SICE International Symposium on System Integration (SII), Ha Long, Vietnam, Jan. 8–11, 2024, doi: 10.1109/SII57402.2024.10417357.
  10. A. A. Saputra, A. R. A. Besari, T. Obo, Kurnianingsih, and N. Kubota, “Concept of Seamless Physical Observation of Human Hand Through Block Design Test,” 2024 IEEE/SICE International Symposium on System Integration (SII), Ha Long, Vietnam, 2024, pp. 272-277, doi: 10.1109/SII58957.2024.10417686.
  11. A. R. A. Besari, S. A. Rahmah, F. Ardilla, A. A. Saputra, T. Obo, and N. Kubota, “Egocentric Behaviour Analysis Based on Object Relationship Extraction for Cognitive Rehabilitation Support,” in Proceedings of the 17th International Conference on Intelligent Robotics and Applications (ICIRA), Xi’an, China, Jul. 31–Aug. 2, 2024.
  12. A. R. A. Besari, A. A. Saputra, F. Ardilla, Q. Song, W. Wang, T. Obo, J. Yamamoto, and N. Kubota, “Enhancing Block-Design Test with Multiscopic CPSS Based on Embodied Integration for Physical and Cognitive Evaluation,” in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Abu Dhabi, UAE, Oct. 14–18, 2024.
  13. A. R. A. Besari, F. Ardilla, A. A. Saputra, Kurnianingsih, T. Obo, and N. Kubota, “Egocentric Behavior Analysis Based on Object Relationship Extraction with Graph Transfer Learning for Cognitive Rehabilitation Support,” in Proceedings of the 7th International Conference on Information Science and Technology (ICIST), Bali, Indonesia, Apr. 8–11, 2024.

PAGE TOP
Top