I am currently a P.h.D student at Artificail Intelligence Thrust, Information Hub, The Hong Kong University of Science and Technology, Guangzhou, supervised by Prof. Hui Xiong.

I am now working on vision-language-action model, human in the loop and Neural Interface research. If you are seeking any form of academic cooperation, please feel free to email me at guoweiyu96@gmail.com.

My research interest includes Bio-Inspired Neural Network, Neural Interface, Multimodal Large Langugae Model and Robotic manipulation. I have published 20+ papers at the top international AI conferences such as NeurIPS, ECCV, THMS. And I aslo pubilished 10+ papers in top journals of Neural Engineering and Robotics such as JNE, TNSRE, RA-L.

📚 Achievements

Published 27 international papers.
Applied for 15 patents, including 2 PCT international patents.
Involved in writing one book chapter (Generalization with Deep Learning) on world scientific book.
Reported by media such as People’s Daily（人民日报）, China Central Television(央视新闻), and Guangzhou Daily.
Founded a company with a valuation of more than 70 million yuan.

🎓 Education

2022.08 - NOW, The Hong Kong University of Science and Technology, Artifical Intelligence, P.h.D candidate (2022-至今)
2019.08 - 2022.6, University of Chinese Academy of Science, School of Artificail Intelligence, Master graduate (2019-2022)
2015.09 - 2019.06, Dalian Universty of Technology(大连理工大学), School of Software Engineering, Bachelor degree (2015-2019)

🎓 COOPERTATION

• 2021.9 - 2022.6, RA at Johns Hopkins University, supervised by Professor Alan Yuille (IEEE Fellow) and published a paper in ECCV together.
• 2019.9 - Now, Collaboration with Professor Dario Farina of Imperial College London (ICL) and we published paper in JNE, THMS together.

📝 Publications

ICCV 2025 submitted

Guo, Weiyu, Ziyang Chen, Shaoguang Wang, Jianxiang He, Yijie Xu, Jinhui Ye, Ying Sun, and Hui Xiong. “Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding.” ICCV submitted (2025). [预览]

NeurIPS 2024

Guo, Weiyu, Ying Sun, Yijie Xu, Ziyue Qiao, Yongkui Yang, and Hui Xiong. “SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network.” NeurIPS (2024). [预览]

ECCV. 2024

Guo, Weiyu, Li, Zhaoshuo, Yang, Yongkui, Wang, Zheng, Taylor, Russell H, Unberath, Mathias, Yuille, Alan, Li, Yingwei. “Context-Enhanced Stereo Transformer.” ECCV2022 (2022) [预览]

JNE

Guo, Weiyu, Ma, Chenfei, Wang, Zheng, Zhang, Hang, Farina, Dario, Jiang, Ning, Lin, Chuang. “Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals.” Journal of Neural Engineering 18(2) 026027 (2021). IOP Publishing

THMS. 2023

Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong, Wang, Zheng, Lin, Chuang, Xiong, Hui. “Multi-attention feature fusion network for accurate estimation of finger kinematics from surface electromyographic signals.” IEEE Transactions on Human-Machine Systems 53(3) 512-519 (2023). IEEE

Guo, Weiyu, Ma, Chenfei, Wang, Zheng, Zhang, Hang, Farina, Dario, Jiang, Ning, Lin, Chuang. “Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals.” Journal of Neural Engineering 18(2) 026027 (2021). IOP Publishing
Wang, Chao, Guo, Weiyu, Zhang, Hang, Guo, Linlin, Huang, Changcheng, Lin, Chuang. “sEMG-based continuous estimation of grasp movements by long-short term memory network.” Biomedical Signal Processing and Control 59 101774 (2020). Elsevier
Guo, Linlin, Zhang, Hang, Wang, Chao, Guo, Weiyu, Diao, Guangqiang, Lu, Bingxian, Lin, Chuang, Wang, Lei. “Towards CSI-based diversity activity recognition via LSTM-CNN encoder-decoder neural network.” Neurocomputing 444 260-273 (2021). Elsevier
Guo, Weiyu, Wang, Chao, Lin, Chuang, Wang, Chenrui. “Long short term memory model based continuous estimation of human finger joint angles.” 2019 IEEE International Conference on Real-time Computing and Robotics (RCAR) 288-292 (2019). IEEE
Zhang, Hang, Wang, Chao, Guo, Weiyu, Guo, Linlin, Lin, Chuang. “DFNN-based gesture recognition with the shift and damage of the HD-sEMG electrodes.” 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO) 1275-1279 (2019). IEEE
Guo, Linlin, Zhang, Hang, Guo, Weiyu, Fang, Jian, Lu, Bingxian, Ma, Chenfei, Li, Guanglin, Lin, Chuang, Wang, Lei. “Deep Learning for Device-free Human Activity Recognition Using WiFi Signals.” Generalization With Deep Learning: For Improvement On Sensing Capability 101-137 (2021)
Chen, Chao, Guo, Weiyu, Ma, Chenfei, Yang, Yongkui, Wang, Zheng, Lin, Chuang. “sEMG-based continuous estimation of finger kinematics via large-scale temporal convolutional network.” Applied Sciences 11(10) 4678 (2021). MDPI
Wang, Zheng, Wang, Zhuo, Liao, Jian, Chen, Chao, Yang, Yongkui, Dong, Bo, Chen, Weiguang, Chen, Wenxuan, Lei, Ming, Guo, Weiyu. “CNN-DMA: a predictable and scalable direct memory access engine for convolutional neural network with sliding-window filtering.” Proceedings of the 2021 Great Lakes Symposium on VLSI 115-121 (2021)
Chen, Wenxuan, Wang, Zheng, Lei, Ming, Dong, Bo, Wang, Zhuo, Yang, Yongkui, Chen, Chao, Guo, Weiyu, Liang, Chen, Zhang, Qian. “Improving system latency of AI accelerator with on-chip pipelined activation preprocessing and multi-mode batch inference.” 2021 IEEE 3rd International Conference on Artificial Intelligence Circuits and Systems (AICAS) 1-4 (2021). IEEE
Ma, Chenfei, Guo, Weiyu, Zhang, Hang, Samuel, Oluwarotimi Williams, Ji, Xiaopeng, Xu, Lisheng, Li, Guanglin. “A novel and efficient feature extraction method for deep learning based continuous estimation.” IEEE Robotics and Automation Letters 6(4) 7341-7348 (2021). IEEE
Ma, Chenfei, Lin, Chuang, Samuel, Oluwarotimi Williams, Guo, Weiyu, Zhang, Hang, Greenwald, Steve, Xu, Lisheng, Li, Guanglin. “A bi-directional LSTM network for estimating continuous upper limb movement from surface electromyography.” IEEE Robotics and Automation Letters 6(4) 7217-7224 (2021). IEEE
Chen, Rui, Chen, YuanZhi, Guo, Weiyu, Chen, Chao, Wang, Zheng, Yang, Yongkui. “SEMG-based gesture recognition using GRU with strong robustness against forearm posture.” 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR) 275-280 (2021). IEEE
Ma, Chenfei, Guo, Weiyu, Xu, Lisheng, Li, Guanglin. “Finger joint angle estimation based on sEMG signals and deep learning method.” 2021 IEEE International Conference on Real-time Computing and Robotics (RCAR) 638-643 (2021). IEEE
Guo, Weiyu, Li, Zhaoshuo, Yang, Yongkui, Wang, Zheng, Taylor, Russell H, Unberath, Mathias, Yuille, Alan, Li, Yingwei. “Context-Enhanced Stereo Transformer.” ECCV2022 (2022)
Lin, Chuang, Chen, Xingjian, Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong. “A BERT based method for continuous estimation of cross-subject hand kinematics from surface electromyographic signals.” IEEE Transactions on Neural Systems and Rehabilitation Engineering 31 87-96 (2022). IEEE
Guo, Weiyu, Jiang, Ning, Farina, Dario, Su, Jingyong, Wang, Zheng, Lin, Chuang, Xiong, Hui. “Multi-attention feature fusion network for accurate estimation of finger kinematics from surface electromyographic signals.” IEEE Transactions on Human-Machine Systems 53(3) 512-519 (2023). IEEE
Zhang, He, Sun, Ying, Guo, Weiyu, Liu, Yafei, Lu, Haonan, Lin, Xiaodong, Xiong, Hui. “Interactive interior design recommendation via coarse-to-fine multimodal reinforcement learning.” Proceedings of the 31st ACM International Conference on Multimedia 6472-6480 (2023)
Zhang, Gaomin, Guo, Weiyu, Xiong, Xi, Guan, Zhongcheng. “A hybrid approach combining data envelopment analysis and recurrent neural network for predicting the efficiency of research institutions.” Expert Systems with Applications 238 122150 (2024). Pergamon
Qiao, Ziyue, Xiao, Meng, Guo, Weiyu, Luo, Xiao, Xiong, Hui. “Information filtering and interpolating for semi-supervised graph domain adaptation.” Pattern Recognition 153 110498 (2024). Pergamon
Lu, Yunfan, Xu, Yijie, Ma, Wenzong, Guo, Weiyu, Xiong, Hui. “Event camera demosaicing via swin transformer and pixel-focus loss.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 1095-1105 (2024)
Guo, Weiyu, Qiao, Ziyue, Sun, Ying, Xiong, Hui. “Revisiting Noise Resilience Strategies in Gesture Recognition: Short-Term Enhancement in Surface Electromyographic Signal Analysis.” arXiv preprint arXiv:2404.11213 (2024)
Chen, Xingjian, Guo, Weiyu, Lin, Chuang, Jiang, Ning, Su, Jingyong. “Cross-subject lifelong learning for continuous estimation from surface electromyographic signal.” IEEE Transactions on Neural Systems and Rehabilitation Engineering (2024). IEEE
Guo, Weiyu, Sun, Ying, Xu, Yijie, Qiao, Ziyue, Yang, Yongkui, Xiong, Hui. “SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network.” Neurips 2024 (2024)
Wu, Yaqi, Fan, Zhihao, Chu, Xiaofeng, Ren, Jimmy S, Li, Xiaoming, Yue, Zongsheng, Li, Chongyi, Zhou, Shangcheng, Feng, Ruicheng, Dai, Yuekun. “Mipi 2024 challenge on demosaic for hybridevs camera: Methods and results.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 1136-1143 (2024)
Lin, Chuang, Zhao, Chunxiao, Zhang, Jianhua, Chen, Chen, Jiang, Ning, Farina, Dario, Guo, Weiyu. “Continuous Estimation of Hand Kinematics from Electromyographic Signals based on Power-and Time-Efficient Transformer Deep Learning Network.” IEEE Transactions on Neural Systems and Rehabilitation Engineering (2024). IEEE
Yunfan, LU, Xu, Xiaogang, Hao, LU, Qian, Yanlin, Yang, Bin, Li, Junyi, Cai, Qianyi, Guo, Weiyu, Xiong, Hui. “SEE: See Everything Every Time-Broader Light Range Image Enhancement via Events.” (n.d.)
Guo, Weiyu, Sun, Guoying, He, JianXiang, Shao, Tong, Wang, Shaoguang, Chen, Ziyang, Hong, Meisheng, Sun, Ying, Xiong, Hui. “A Survey of fMRI to Image Reconstruction.” arXiv preprint arXiv:2502.16861 (2025)
Lu, Yunfan, Xu, Xiaogang, Lu, Hao, Qian, Yanlin, Li, Pengteng, Yao, Huizai, Yang, Bin, Li, Junyi, Cai, Qianyi, Guo, Weiyu. “SEE: See Everything Every Time–Adaptive Brightness Adjustment for Broad Light Range Images via Events.” arXiv preprint arXiv:2502.21120 (2025)
Guo, Weiyu, Chen, Ziyang, Wang, Shaoguang, He, Jianxiang, Xu, Yijie, Ye, Jinhui, Sun, Ying, Xiong, Hui. “Logic-in-Frames: Dynamic Keyframe Search via Visual Semantic-Logical Verification for Long Video Understanding.” arXiv preprint arXiv:2503.13139 (2025)

Selected Patents

Training method, training device of continuous motion information prediction model PCT/CN2020/133443
Intelligent interactive glove with AI chip, interactive method and storage medium PCT/CN2021/107108
Power efficiency test method, adjustment method, computer equipment CN202010389035.4
An in-memory computing accelerator and its optimization method CN202011406904.6
An automatic optimization method of graph data processing framework CN202011358762.0

🏅 Awards