Short Biography
|
|
I am an assistant professor of School of Intelligent Software and Engineering at Nanjing University. I received my Ph.D. degree from Nanjing University in 2017 under the supervision of Prof. Sanglu Lu and Prof. Lei Xie, and received my BE degree from Nanjing University of Science and Technology in 2011. From Sep. 2014 to Sep. 2015, I was a visiting research scholar in Department of Computer Science at the College of William and Mary, supervised by Prof. Qun Li and sponsored in part by China Scholarship Council (CSC). From Jul. 2017 to Jun. 2023, I was an assistant, associate researcher in Department of Computer Science and Technology at Nanjing University.
| |
Research Interest
|
|
My research interests focus on computer vision based human activity recognition, intelligent sensing with mobile devices, augmented reality, etc., including algorithm design and system implementation.
| |
|
|
I am recruiting motivated Ph.D. or master students who would like to work on the above-mentioned areas. Undergraduate students who are interested in the related topics are also encouraged to contact me.
|
|
Projects
|
2022/01-2025/12: “Multi-modal Sensing based Activity Recognition on Mobile Devices”, sponsored by the National Natural Science Foundation of China, No. 62172208. (Principle Investigator)
| |
2019/01-2021/12: “Efficient Activity Sensing and Recognition based on Mobile Devices”, sponsored by the National Natural Science Foundation of China, No. 61802169. (Principle Investigator)
| |
|
2018/07-2021/06: “Multimodal Sensing and Activity Recognition based on Mobile Devices”, sponsored by the JiangSu Natural Science Foundation, No. BK20180325. (Principle Investigator)
|
|
Teaching
|
计算机组织结构（2024秋）
|
|
物联网应用软件开发（2024秋）
|
|
互联网计算（2024春）
|
|
Publications
|
2024 |
Yafeng Yin, Lei Xie, Zhiwei Jiang, Fu Xiao, Jiannong Cao, and Sanglu Lu. A Systematic Review of Human Activity Recognition based on Mobile Devices: Overview, Progress and Trends. IEEE Communications Surveys and Tutorials, DOI: 10.1109/COMST.2024.3357591, 2024. (Impact Factor: 35.6)
Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Hongkai Wen, Lei Xie, and Sanglu Lu. SignGraph: A Sign Sequence is Worth Graphs of Nodes. The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Shiping Ge, Qiang Chen, Zhiwei Jiang, Yafeng Yin, Ziyao Chen, and Qing Gu. Short Video Ordering via Position Decoding and Successor Prediction. International Conference on Research and Development in Information Retrieval (SIGIR), 2024.
| |
2023 |
Yafeng Yin, Zheng Wang, Kang Xia, Lei Xie, and Sanglu Lu. Acoustic-Based Lip Reading for Mobile Devices: Dataset, Benchmark and A Self Distillation-Based Approach. IEEE Transactions on Mobile Computing, 2023.
Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Lei Xie, and Sanglu Lu. Towards Real-Time Sign Language Recognition and Translation on Edge Devices. ACM International Conference on Multimedia (ACM MM), 2023.
Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Kang Xia, Lei Xie, and Sanglu Lu. Contrastive Learning for Sign Language Recognition and Translation. International Joint Conference on Artificial Intelligence (IJCAI), 2023.
Shiping Ge, Zhiwei Jiang, Yafeng Yin, Cong Wang, Zifeng Cheng and Qing Gu. Learning Event-Specific Localization Preferences for Audio-Visual Event Localization. ACM International Conference on Multimedia (ACM MM), 2023.
Zhiwei Jiang, Tianyi Gao, Yafeng Yin, Meng Liu, Hua Yu, Zifeng Cheng, and Qing Gu. Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation Learning. Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
Cong Wang, Zhiwei Jiang, Yafeng Yin, Zifeng Cheng, Shiping Ge, and Qing Gu. Aggregating Multiple Heuristic Signals as Supervision for Unsupervised Automated Essay Scoring. Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
Yuliang Liu, Zhiwei Jiang, Yafeng Yin, Cong Wang, Sheng Chen, Zhaoling Chen, and Qing Gu. Unsupervised Readability Assessment via Learning from Weak Readability Signals. International Conference on Research and Development in Information Retrieval (SIGIR), 2023.
Cong Wang, Zhiwei Jiang, Yafeng Yin, Zifeng Cheng, Shiping Ge, and Qing Gu. Controlling Class Layout for Deep Ordinal Classification via Constrained Proxies Learning. AAAI Conference on Artificial Intelligence (AAAI), 2023.
Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Cong Wang, Shiping Ge, and Qing Gu. A Consistent Dual-MRC Framework for Emotion-Cause Pair Extraction. ACM Transactions on Information Systems (TOIS), vol. 41, no. 4, article 105, 2023.
Shiping Ge, Zhiwei Jiang, Zifeng Cheng, Cong Wang, Yafeng Yin, and Qing Gu. Learning Robust Multi-Modal Representation for Multi-Label Emotion Recognition via Adversarial Masking and Perturbation. The Web Conference (WWW), 2023.
| |
2022 |
Hao Zhang, Yafeng Yin*, Lei Xie, Tao Gu, Minghui You and Sanglu Lu. DynaKey: Dynamic Keystroke Tracking using a Head-Mounted Camera Device. IEEE Internet of Things Journal, vol. 9, no. 9, pp. 6563-6577, 2022.
Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Cong Wang, and Qing Gu. Learning to Classify Open Intent via Soft Labeling and Manifold Mixup. IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 30:635-645, 2022.
| |
2021 |
Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Lei Xie, and Sanglu Lu. Skeleton-Aware Neural Sign Language Translation. ACM International Conference on Multimedia (ACM MM), 2021.
Yanling Bu, Lei Xie, Yafeng Yin, Chuyu Wang, Jingyi Ning, Jiannong Cao, and Sanglu Lu. Handwriting-Assistant: Reconstructing Continuous Strokes with Millimeter-level Accuracy via Attachable Inertial Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), vol. 5, no. 4, article 146, 2021. (UbiComp 2022)
Zhiwei Jiang, Meng Liu, Yafeng Yin, Hua Yu, Zifeng Cheng, and Qing Gu. Learning from Graph Propagation via Ordinal Distillation for One-Shot Automated Essay Scoring. The Web Conference (WWW), 2021.
Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Na Li, and Qing Gu. A Unified Target-Oriented Sequence-to-Sequence Model for Emotion-Cause Pair Extraction. IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 29:2779-2791, 2021.
| |
2020 |
Xinchen Zhang, Yafeng Yin*, Lei Xie, Hao Zhang, Zefan Ge, and Sanglu Lu. TouchID: User Authentication on Mobile Devices via Inertial-Touch Gesture Analysis. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), vol. 4, no. 4, article 162, 2020. (UbiComp 2021).
Hao Zhang, Yafeng Yin*, Lei Xie, and Sanglu Lu. AirTyping: A Mid-Air Typing Scheme based on Leap Motion. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers, pp. 168-171. 2020.
Lingyu Zhang, Yafeng Yin*, Lei Xie, and Sanglu Lu. HmwkCheck: A Homework Auto-Checking System based on Arithmetic Operation Recognition using Smartphones. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers, pp. 172-175. 2020.
Xinran Lu, Lei Xie, Yafeng Yin, Wei Wang, Yanling Bu, Qing Guo, and Sanglu Lu. SpeedTalker: Automobile Speed Estimation via Mobile Phones. IEEE Transactions on Mobile Computing, 2020. DOI: 10.1109/TMC.2020.3034354.
Fei Han, Lei Xie, Yafeng Yin, Hao Zhang, Guihai Chen, and Sanglu Lu. Video Stabilization for Camera Shoot in Mobile Devices via Inertial-Visual State Tracking. IEEE Transactions on Mobile Computing, 2020. DOI: 10.1109/TMC.2019.2961313.
Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Hua Yu, and Qing Gu. A Symmetric Local Search Network for Emotion-Cause Pair Extraction. Proceedings of the 28th International Conference on Computational Linguistics (COLING), 139–149, 2020.
| |
2019 |
Yafeng Yin, Lei Xie, Tao Gu, Yijia Lu and Sanglu Lu. AirContour: Building Contour-based Model for in-Air Writing Gesture Recognition. ACM Transactions on Sensor Networks, vol. 15, no. 4, No. 44, 2019.
Zhiwei Jiang, Qing Gu, Yafeng Yin, Jiangxiang Wang, and Daoxu Chen. GRAW+: A Two-View Graph Propagation Method with Word Coupling for Readability Assessment. Journal of the Association for Information Science and Technology, vol. 70, no. 5, pp.433-447, 2019.
| |
2018
|
Yafeng Yin, Qun Li, Lei Xie, Shanhe Yi, Ed Novak, and Sanglu Lu. CamK: Camera-based Keystroke Detection and Localization for Small Mobile Devices. IEEE Transactions on Mobile Computing, vol. 17, no. 10, pp. 2236-2251, 2018.
Zhiwei Jiang, Qing Gu, Yafeng Yin, and Daoxu Chen. Enriching Word Embedding with Domain Knowledge for Readability Assessment. International Conference on Computational Linguistics (COLING), 2018.
Lei Xie, Qingliang Cai, Alex X. Liu, Wei Wang, Yafeng Yin, and Sanglu Lu. Synchronize Inertial Readings from Multiple Mobile Devices in Spatial Dimension. IEEE/ACM Transactions on Networking, vol. 26, no. 5, pp. 2146-2159, 2018.
| |
2017
|
Yafeng Yin, Lei Xie, Yuanyuan Fan, and Sanglu Lu. Tracking Human Motions in Photographing: A Context-Aware Energy-Saving Scheme for Smart Phones. ACM Transactions on Sensor Networks, vol. 13, no. 4, pp. 29, 2017.
Yijia Lu, Fei Han, Lei Xie, Yafeng Yin, Congcong Shi, and Sanglu Lu. I am the UAV: A Wearable Approach for Manipulations of Unmanned Aerial Vehicle. IEEE SmartComp [WIP/Demo Paper], 2017.
| |
2016
|
Yafeng Yin, Lei Xie, Jie Wu, and Sanglu Lu. Focus and Shoot: Exploring Auto-Focus in RFID Tag Identification Towards a Specified Area. IEEE Transactions on Computers, vol. 65, no. 3, pp. 888-901, 2016.
Yafeng Yin, Qun Li, Lei Xie, Shanhe Yi, Edmund Novak, and Sanglu Lu. CamK: a Camera-based Keyboard for Small Mobile Devices. Proc. of IEEE INFOCOM, 2016. (Best-in-Session Presentation Award)
Shanhe Yi, Zhengrui Qin, Ed Novak, Yafeng Yin, and Qun Li. GlassGesture: Exploring Head Gesture Interface of Smart Glasses. Proc. of IEEE INFOCOM, 2016.
| |
2015
|
Yuanyuan Fan, Lei Xie, Yafeng Yin, and Sanglu Lu. A Context Aware Energy-Saving Scheme for Smart Camera Phones based on Activity Sensing. Proc. of IEEE MASS, 2015.
Hao Ji, Lei Xie, Chuyu Wang, Yafeng Yin and Sanglu Lu. CrowdSensing: a Crowd-Sourcing based Indoor Navigation using RFID-based Delay Tolerant Network. Journal of Network and Computer Applications, vol. 52, pp. 79-89, 2015.
| |
2014
|
Yafeng Yin, Lei Xie, Sanglu Lu, and Daoxu Chen. Check out the Rules: towards Time-Efficient Rule Checking over RFID Tags. Mobile Networks and Applications, vol. 19, no. 4, pp. 524-533, 2014.
Lei Xie, Yafeng Yin, Athanasios V. Vasilakos, and Sanglu Lu. Managing RFID Data: Challenges, Opportunities and Solutions. IEEE Communications Surveys and Tutorials, vol. 16, no.3, pp. 1294-1311, 2014.
Xiang Lu, Lei Xie, Yafeng Yin, Wei Wang, Baoliu Ye, and Sanglu Lu. Efficient Localization based on Imprecise Anchors in RFID System. Proc. of IEEE ICC, 2014.
| |
2013
|
Yafeng Yin, Lei Xie, Jie Wu, Athanasios V. Vasilakos, and Sanglu Lu. Focus and Shoot: Efficient Identification over RFID Tags in the Specified Area. Proc. of MobiQuitous, 2013. (Best Paper Award)
Yafeng Yin, Lei Xie, Sanglu Lu, and Daoxu Chen. Efficient Protocols for Rule Checking in RFID Systems. Proc. of IEEE ICCCN, 2013.
Lei Xie, Yafeng Yin, Xiang Lu, Bo Sheng and Sanglu Lu. iFridge: An Intelligent Fridge for Food Management based on RFID Technology. Proc. of ACM UbiComp, 2013. [Video Paper]
Lei Xie, Yafeng Yin, Xi Chen, Sanglu Lu, and Daoxu Chen. RFID Data Management: Algorithms, Protocols and Performance Evaluation. Chinese Journal of Computers, vol. 36, no. 3, pp. 457-470, 2013.
Hao Ji, Lei Xie, Yafeng Yin, and Sanglu Lu. An Efficient Indoor Navigation Scheme Using RFID-based Delay Tolerant Network. Proc. of IEEE GLOBECOM, 2013.
| |
Selected Awards
|
2018 ACM Nanjing Rising Star Award
2018 Jiangsu Computer Society Outstanding Doctoral Dissertation Award
2018 Outstanding Doctoral Dissertation Award at Nanjing University
2017 Six Talent Peaks Project in Jiangsu Province
2017 ACM Nanjing Doctoral Dissertation Award (Ranking first)
2016 Program A for outstanding PhD candidate of Nanjing University (Only 9 students at Nanjing University)
2016 Best-in-Session Presentation Award in IEEE INFOCOM 2016
2015 National Scholarship for doctoral students
2015 Google Anita Borg Memorial Scholarship Asia Pacific (Only 9 winners from China Mainland)
2015 President Special Scholarship for Doctoral Student at Nanjing University (Only two CS Ph.D. students)
2014 Joint-PhD Student Scholarship of China Scholarship Council
2013 Best Paper Award in MobiQuitous 2013 (Only one paper won the award)
2013 National Grand Prize for the Third National Contest of Innovative Application Design
2011 Excellence plan at Nanjing University
| |
Students
|
PhD Students
Shiwei Gan (2019-present)
Master Students
Zhong Liu (2020-present)
Minghui You (2020-present)
Alumni
Hao Zhang (Master 2018, Microsoft)
Xinchen Zhang (Master 2018, Alibaba)
Zheng Wang (Master 2019, ByteDance)
| |
Contact
|
Room 225, School of Intelligent Software and Engineering,
Nanjing University, Suzhou Campus,
1520 Taihu Road,
Suzhou 215163, China
| |
