About Me

Cinque Terre

Zhilei Liu (刘志磊)

Ph.D, Assistant Professor

School of Computer Science and Technology, Tianjin University

92 Weijin Road, NanKai District, TianJin, P. R. China, 300072

Email: zhileiliu@tju.edu.cn

I received my Ph.D. degree of Computer Science from University of Science and Technology of China (USTC) in Jun. 2014, advised by Prof. Shangfei Wang and Prof. Xiaoping Chen. I was a visiting student in Intelligent Systems Lab (ISL) of Rensselaer Polytechnic Institute (RPI) under the supervision of Prof. Qiang Ji, from Dec. 2012 to Jul. 2013. I worked as an engineer in China Academy of Electronics and Information Technology (CAEIT) from Jul. 2014 to Oct. 2014. After that, I moved to School of Computer Science and Technology in Tianjin University as an assistant professor.

News&Updates

Update Several positions are available for highly motivated students who are interested in pursuing Master or Ph.D degrees in the areas of Machine Learning and Patten Recognition. Please feel free to contact me if you are interested.

Research Interests

Affective Computing Machine Learning Pattern Recognition Computer Vision

Research Projects

Study on Expression Recognition Methods based on Probabilistic Graphical Model by Fusing Cognitive Mechanism New
  • PI, 2016.01-2018.12, NSFC Project
  • In this project, noval facial expression recognition methods based on probabilistic graphical models will be studied, and the cognitive mechanisms obtained during the expression cognition research will be adopted as hidden knowledge.
    A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference
  • 2009.01-2010.12, National 863 Project
  • In this work, we proposed and established a natural visible and infrared facial expression database, which contains both spontaneous and posed expressions of more than 100 subjects, recorded simultaneously by a visible and an infrared thermal camera, with illumination provided from three different directions. [USTC-NVIE Database]
    Implicit Video Emotion Tagging from Audience's Facial Expressions
  • 2012.01-2015.12, NSFC Project
  • In this work, a novel multiple emotional tagging method based on multi-expressions is proposed, in which, multi-expressions are recognized by exploring dependencies among expressions. In addition, we model the relationships between outer expressions and inner emotions using a Bayesian Network.
    Eye Localization from Thermal Infrared Images
  • 2009.01-2010.12,National 863 Project
  • By using the knowledge of facial structure and temperature distribution, in this work, we proposed an automatic eye localization method from long wave infrared thermal images both with eyeglasses and without eyeglasses.

    Publications

    Journal Papers

    1. Shangfei Wang, Zhilei Liu, etc.: Implicit video emotion tagging from audiences' facial expression. Multimedia Tools and Applications, Volume 74, Issue 13, pp. 4679-4706, July 2015, ISSN 1573-7721.New
    2. Shangfei Wang, Zhilei Liu, etc.: Exploiting Multi-expression Dependences for Implicit Multi-Emotion Video Tagging. Image and Vision Computing, Volume 32, Issue 10, October 2014, Pages 682-691, ISSN 0262-8856.
    3. Shangfei Wang, Zhilei Liu, etc.: Eye localization from thermal infrared images. Pattern Recognition, Elsevier, Volume 46, Issue 10, Pages 2613-2621, October 2013.
    4. Shangfei Wang, Zhilei Liu, etc.: Analyses of a Multi-modal Spontaneous Facial Expression Database. IEEE Transactions on Affective Computing, Vol.4, No.1, pp.34-46. Jan.-June 2013.
    5. Shangfei Wang, Zhilei Liu, etc.: A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference. IEEE Transaction on Multimedia, Vol.12, No.7, pp.682-69. November 2010.

    Conference Papers

    1. Bogu Li, Zhilei Liu, Jianwu Dang: Study on the Relation of Fundamental and Formant Frequencies for Affective Speech Synthesis, ISCSLP 2016, October 17-20, 2016, Tianjin New
    2. Hui Feng, Wenfu Bao, Jianwu Dang, Zhilei Liu: Perception of Mandarin Tones by Native Tibetan, INTERSPEECH 2015, pp. 811-814, September 6-10, 2015, Dresden, Germany New
    3. Guancheng Li, Jianwu Dang, Gaoyan Zhang, Zhilei Liu: Investigation of relation between speech perception and production based on EEG source reconstruction, Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2015), Dec. 16-19, 2015. New
    4. Baoyuan Wu, Zhilei Liu, Shangfei Wang, Baogang Hu, Qiang Ji: Multi-label Learning with Missing Labels. 2014 22nd International Conference on Pattern Recognition (ICPR), vol., no., pp.1964,1968, 24-28 Aug. 2014. [oral]
    5. Menghua He, Shangfei Wang, Zhilei Liu: Analyses of the Differences between Posed and Spontaneous Facial Expressions. 5th International Conference on Affective Computing and Intelligent Interaction, ACII 2013. September 2-5, 2013, Geneva, Switzerland.
    6. Zhilei Liu, Shangfei Wang, Zhaoyu Wang, and Qiang Ji: Implicit Video Multi-Emotion Tagging by Exploiting Multi-Expression Relations. 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, April 22, 2013 - April 26, 2013, Shanghai, China. [oral]
    7. Zhaoyu Wang, Shangfei Wang, Menghua He, Zhilei Liu, Qiang Ji: Emotional tagging of videos by exploring multi-emotion coexistence. 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2013, April 22, 2013 - April 26, 2013, Shanghai, China.
    8. Zhilei Liu, Shangfei Wang: Posed and Spontaneous Expression Distinguishment from Infrared Thermal Images. The 21st International Conference on Pattern Recognition (ICPR 2012), Tsukuba, Japan. 2012. [oral]
    9. Shangfei Wang, Peijia Shen, Zhilei Liu: Eye Localization from Infrared Thermal Images. Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction (MPRSS 2012), LNCS, Vol 7742, 2013, pp. 35-42. Tsukuba, Japan. 2012. [oral]
    10. Shangfei Wang, Peijia Shen, Zhilei Liu: Facial Expression Recognition from Infrared Thermal Images using Temperature Difference by Voting. The 2nd IEEE International Conference on Cloud Computing and Intelligence Systems (IEEE CCIS2012), vol.01, no., pp.94,98, Oct. 30 2012-Nov. 1 2012, Hangzhou, China. 2012.
    11. Peijia Shen, Shangfei Wang, Zhilei Liu: Facial Expression Recognition from Infrared Thermal Videos. The 12th International Conference on Intelligent Autonomous Systems (IAS-12), Advances in Intelligent Systems and Computing, Volume 194, 2013, pp 323-333 Jeju Island, Korea, 2012.
    12. Zhilei Liu, Shangfei Wang: Emotion Recognition Using Hidden Markov Models from Facial Temperature Sequence. International Conference on Affective Computing and Intelligent Interaction, ACII 2011, Part II, LNCS 6975, pp.240-247, 2011 [oral]
    13. Shangfei Wang, Zhilei Liu: Infrared Face Recognition Based on Histogram and K-Nearest Neighbor Classification. 7th International Symposium on Neural Networks, ISNN (2) 2010: 104-111, Shanghai, China [oral]

    Technical Reports

    1. Shangfei Wang, Zhilei Liu, Xiaoping Chen, Xufa Wang: Affective Human-Robot Interaction Research in USTC (Extended Abstract), NSF/WTEC Workshop on Human-Robot Interaction, Oct. 2011, Beijing, China. [Presentation]

    Dissertation

  • [Ph. D, University of Science and Technology of China] The Applied Research of Probabilistic Graphic Model on Affective Computing (May 2014, in Chinese)
  • Academic Activities

  • Member of IEEE, CCF
  • Invited Reviewer, Multimedia Systems
  • Guest Reviewer, IEEE Transactions on Affective Computing
  • Guest Reviewer, IEEE Transactions on Multimedia
  • Guest Reviewer, Image and Vision Computing Journal
  • Guest Reviewer, ICCV 2013
  • Teaching

  • Graduate courses
  • Frontier of Cognitive Computing and Intelligent Information Processing
  • Undergraduate courses
  • Introduction to Computing Principles
    Computer Network
    Introduction to Affective Computing

    Resources

    Resource collection for related research groups, tutorials, courses, toolboxes, datasets and so on.