The FIPA’s objective is to conduct research on automatic processing of facial images in order to build systems that can read the faces as humans do. The following research topics are covered by the group:

The FIPA is directed by Dr.-Ing. Ekenel, who has several years of expertise on face analysis with the focus face recognition. He has received the EBF European Biometric Research Award in 2008 and, with his team, the Best Demo Award at the IEEE International Conference on Automatic Face and Gesture Recognition in 2008.

The FIPA is part of the Computer Vision for Human-Computer Interaction Lab in the Institute for Anthropomatics, at the Computer Science Department of the Karlsruhe Institute of Technology (KIT). The group is funded by the “Concept for the Future” of Karlsruhe Institute of Technology within the framework of the German Excellence Initiative.

Junior Research Group of Dr. Hazım Kemal Ekenel

Book Chapter

• A. Pnevmatikakis, H.K. Ekenel, C. Barras, J. Hernando, “Multimodal Person Identification”, Book Chapter in Computers in the Human Interaction Loop, Human-Computer Interaction Series, Springer Verlag, London, 2009.

Journal Papers

• H.K. Ekenel, J. Stallkamp, R. Stiefelhagen, “A Video-based Door Monitoring System Using Local Appearance-based Face Models”, Computer Vision and Image Understanding, Vol. 114, No. 5, pp. 596 - 608, May 2010.
• K. Bernardin, H.K. Ekenel, R. Stiefelhagen, “Multimodal identity tracking in a smart room.” Personal and Ubiquitous Computing 13(1): 25-31, 2009.
• R. Stiefelhagen, H.K. Ekenel, C. Fügen, P. Gieselmann, H. Holzapfel, F. Kraft, K. Nickel, M. Voit, A. Waibel, "Enabling Multimodal Human-Robot Interaction for the Karlsruhe Humanoid Robot", IEEE Transactions on Robotics, Vol. 23, No. 5, October 2007.
• H. K. Ekenel, H. Gao, R. Stiefelhagen, "3-D Face Recognition using Local Appearance-Based Models", IEEE Transactions on Information Forensics and Security, Vol. 2, No. 3, pp. 630-635, September 2007.
• R. Stiefelhagen, K. Bernardin, H.K. Ekenel, J. McDonough, K. Nickel, M. Voit, M. Wölfel, "Audio-Visual Perception of a Lecturer in a Smart Seminar Room", Signal Processing, Vol. 86 (12), Dec. 2006.
• H.K. Ekenel, B. Sankur, "Multiresolution Face Recognition", Image and Vision Computing, Vol. 23, No.5, pp. 469-477, May 2005.
• H.K. Ekenel, B. Sankur, "Feature selection in the independent component subspace for face recognition", Pattern Recognition Letters, Vol. 25, No. 12, pp. 1377-1388, Sept. 2004.

Conference Papers
2010

• H.K. Ekenel, T. Semela, R. Stiefelhagen, “Content-based Video Genre Classification Using Multiple Cues”, In Proc. of 3rd Intl. Workshop on Automated Information Extraction in Media Production (AIEMPro’10), Florence, Italy, October 2010.
• H. Gao, H.K. Ekenel, R. Stiefelhagen, “Robust Open-Set Face Recognition for Small-Scale Convenience Applications”, In Proc. of 32nd Annual Symposium of the German Association for Pattern Recognition (DAGM’10), Darmstadt, Germany, September 2010.
• M. Bäuml, K. Bernardin, M. Fischer, H.K. Ekenel, R. Stiefelhagen, “Multi-Pose Face Recognition for Person Retrieval in Camera Networks”, In Proc. of 7th IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS’10), Boston, USA, September 2010.
• H.K. Ekenel, R. Stiefelhagen, “Automatic Frequency Band Selection for Illumination Robust Face Recognition”, In Proc. of Intl. Conf. on Pattern Recognition (ICPR’10), Istanbul, Turkey, August 2010.
• H. Gao, H.K. Ekenel, M. Fischer, R. Stiefelhagen, “Multi-resolution Local Appearance-based Face Verification”, In Proc. of Intl. Conf. on Pattern Recognition (ICPR’10), Istanbul, Turkey, August 2010.
• L. Rybok, M. Voit, H.K. Ekenel, R. Stiefelhagen, “Multi-view Based Estimation of Human Upper-Body Orientation”, In Proc. of Intl. Conf. on Pattern Recognition (ICPR’10), Istanbul, Turkey, August 2010.
• M. Fischer, H.K. Ekenel, R. Stiefelhagen, “Interactive person re-identification in TV series”, In Proc. of Intl. Workshop on Content-based Multimedia Indexing (CBMI’10), Grenoble, France, June 2010.

2009

• H.K. Ekenel, A. Schumann, H. Gao, R. Stiefelhagen, “Karlsruhe Institute of Technology (KIT) at TRECVID 2009”, TRECVID Evaluation Workshop, Gaithersburg, MD, USA, November 2009.
• H.K. Ekenel, L. Szasz-Toth, R. Stiefelhagen, “Open-set face recognition-based Visitor Interface System”, 7thIntl. Conf. on Computer Vision Systems, LNCS, Vol. 5815, pp. 43-52, Liege, Belgium, October 2009.
• H.K. Ekenel, R. Stiefelhagen, ”Face Alignment by Minimizing the Closest Classification Distance”, In Proc. of Intl. Conf. on Biometrics: Theory, Applications and Systems (BTAS’09), Washington DC, USA, September 2009.
• H.K. Ekenel, R. Stiefelhagen, ”Why is Facial Occlusion a Challenging Problem?”, Intl. Conf. on Biometrics (ICB’09), LNCS, Vol. 5558, pp. 299-308, Alghero, Italy, June 2009.
• H.K. Ekenel, R. Stiefelhagen, ”Generic versus Salient Region-based Partitioning for Local Appearance Face Recognition”, Intl. Conf. on Biometrics (ICB’09), LNCS, Vol. 5558, pp. 367-375, Alghero, Italy, June 2009.
• H. Gao, H.K. Ekenel, R. Stiefelhagen, ”Pose Normalization for Local Appearance-Based Face Recognition”, Intl. Conf. on Biometrics (ICB’09), LNCS, Vol. 5558, pp. 32-41, Alghero, Italy, June 2009.

2008

• H.K. Ekenel, H. Gao, R. Stiefelhagen, “Universität Karlsruhe (TH) at TRECVID 2008”, TRECVID Evaluation Workshop, Gaithersburg, MD, USA, November 2008.
• R. Stiefelhagen, K. Bernardin, H.K. Ekenel, M. Voit, “Tracking Identities and Attention in Smart Environments - Contributions and Progress in the CHIL Project”, In Proc. of 8th IEEE Int. Conference on Face and Gesture Recognition, Amsterdam, Netherlands, September 2008.
• H.K. Ekenel, M. Fischer, E. Tekeli, R. Stiefelhagen, A. Ercil, “Local Binary Pattern Domain Local Appearance Face Recognition”, IEEE Signal Processing, Communication and Applications Conference (SIU 2008), Didim, Turkey, April 2008.
• K. Kumatani, H.K. Ekenel, H. Gao, R. Stiefelhagen, A. Ercil, “Multi-stream Gaussian Mixture Model based Facial Feature Localization”, IEEE Signal Processing, Communication and Applications Conference (SIU 2008), Didim, Turkey, April 2008.

2007

• H.K. Ekenel, M. Fischer, H. Gao, K. Kilgour, J.S. Marcos, R. Stiefelhagen, "Universität Karlsruhe (TH) at TRECVID 2007", TRECVID Evaluation Workshop, Gaithersburg, MD, USA, November 2007.
• J. Stallkamp, H.K. Ekenel, R. Stiefelhagen, "Video-based Face Recognition on Real-World Data", In Proc. of International Conference on Computer Vision (ICCV'07), pp. 1-8, Rio de Jenario, Brasil, October 2007.
• H.K. Ekenel, J. Stallkamp, H. Gao, M. Fischer, R. Stiefelhagen, "Face Recognition for Smart Interactions", In Proc. of IEEE International Conference on Multimedia & Expo, pp. 1007-1010, Beijing, China, July 2007.
• H.K. Ekenel, M. Fischer, R. Stiefelhagen, "Face Recognition in Smart Rooms", Machine Learning for Multimodal Interaction, LNCS, Vol. 4892, pp. 120-131, Brno, Czech Republic, June 2007.
• J. Stallkamp, H.K. Ekenel, H. Erdogan, R. Stiefelhagen, A. Ercil, "Video-Based Driver Identification Using Local Appearance Face Recognition", Workshop on DSP in Mobile and Vehicular Systems, Istanbul, Turkey, June 2007.
• H.K. Ekenel, M. Fischer, Q. Jin, R. Stiefelhagen, "Multi-modal Person Identification in a Smart Environment", In Proc. of CVPR Biometrics Workshop, Minneapolis, USA, June 2007.
• H.K. Ekenel, R. Stiefelhagen, "Local Wavelet Analysis for Face Recognition", IEEE Signal Processing and Communications Applications Conference, Eskisehir, Turkey, June 2007.
• H.K. Ekenel, R. Stiefelhagen, "Two-class Linear Discriminant Analysis for Face Recognition", IEEE Signal Processing and Communications Applications Conference, Eskisehir, Turkey, June 2007.
• H.K. Ekenel, Q. Jin, M. Fischer, R. Stiefelhagen, "“ISL Person Identification Systems in CLEAR 2007", CLEAR Evaluation Workshop, LNCS, Vol. 4625, pp. 256-265, Baltimore, US, May 2007.
• S. Könn, H. Holzapfel, H.K. Ekenel, A. Waibel, "Integrating Face-ID into an Interactive Person-ID Learning System", In Proc. of International Conference on Computer Vision Systems, ICVS 2007, Bielefeld, Germany, March 2007.
• H.K. Ekenel, R. Stiefelhagen, "An Un-awarely Collected Real World Face Database: The ISL-Door Face Database", In Proc. of International Conference on Computer Vision Systems, ICVS 2007, Bielefeld, Germany, March 2007.

2006

• K. Nickel, H.K. Ekenel, M. Voit, R. Stiefelhagen, "Audio-Visual Perception of Humans for a Humanoid Robot", In Proc. of 2nd Intl. Workshop on Human-Centered Robotics Systems, Munich, October 2006.
• H.K. Ekenel, R. Stiefelhagen, "Block Selection in the Local Appearance-based Face Recognition Scheme", In Proc. of CVPR Biometrics Workshop, New York, USA, June 2006.
• H.K. Ekenel, R. Stiefelhagen, "Analysis of Local Appearance-based Face Recognition: Effects of Feature Selection and Feature Normalization", In Proc. of CVPR Biometrics Workshop, New York, USA, June 2006.
• H. Holzapfel, T. Schaaf, H.K. Ekenel, C. Shaa, A. Waibel, "A Robot Learns to Know People - First Contacts of a Robot", In Proc. of 29th German Conference on Artificial Intelligence (KI2006), Bremen, Germany, June 2006.
• K. Bernardin, H.K. Ekenel, R. Stiefelhagen, "Multimodal Identity Tracking in a Smartroom", In Proc. of 3rd IFIP Conference on Artificial Intelligence Applications & Innovations (AIAI), Athens, Greece, June 2006.
• D. Kern, H.K. Ekenel, R. Stiefelhagen, "Illumination Subspaces based Robust Face Recognition", IEEE Signal Processing and Communications Applications Conference, Antalya, Turkey, April 2006.
• H.K. Ekenel, A. Pnevmatikakis, "Video-Based Face Recognition Evaluation in the CHIL Project – Run 1", In Proc of 7th International Conference Automatic Face and Gesture Recognition (FG2006), Southampton, UK, April 2006.
• H.K. Ekenel, Q. Jin, “ISL Person Identification Systems in the CLEAR Evaluations”, CLEAR Evaluation Workshop, LNCS, Vol. 4122, pp. 249-257, Southampton, UK, April 2006.
• K. Nickel, T. Gehrig, H.K. Ekenel, J. McDonough, R. Stiefelhagen. "An Audio-visual Particle Filter for Speaker Tracking on the CLEAR’06 Evaluation Dataset", CLEAR Evaluation Workshop, LNCS, Vol. 4122, pp. 69-80, Southampton, UK, April 2006.

2005

• T. Gehrig, K. Nickel, H.K. Ekenel, U. Klee, J. McDonough, "Kalman Filters for Audio-Video Source Localization", In Proc. of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2005), New York, USA, October, 2005.
• M. Danninger, G. Flaherty, K. Bernardin, H.K. Ekenel, T. Koehler, R. Malkin, R. Stiefelhagen, A. Waibel, "The Connector -Facilitating Context-aware Communication", In Proc. of 7th International Conference on Multimodal Interfaces (ICMI 2005), Trento, Italy, October 2005.
• H.K. Ekenel, R. Stiefelhagen, "Local Appearance based Face Recognition Using Discrete Cosine Transform", In Proc. of 13th European Signal Processing Conference (EUSIPCO 2005), Antalya, Turkey, September 2005.
• M. Wölfel, H.K. Ekenel, "Feature Weighted Mahalanobis Distance: Improved Robustness for Gaussian Classifiers", In Proc. of 13th European Signal Processing Conference (EUSIPCO 2005), Antalya, Turkey, September 2005.
• H.K. Ekenel, R. Stiefelhagen, "A Generic Face Representation Approach for Local Appearance based Face Verification", In Proc. of CVPR IEEE Workshop on Face Recognition Grand Challenge Experiments, San Diego, CA, USA, June 2005.
• H. Erdogan, A. Ercil, H.K. Ekenel, S.Y. Bilgin, I. Eden, M. Kirisci, "Mutlimodel Person Recognition for Vehicular Applications", 6th International Workshop on Multiple Classifier Systems (MCS 2005), LNCS, Vol. 3541, pp. 366–375, California, USA, June 2005.

2004

• E. Arisoy, M.L. Arslan, M.N. Demiralp, H.K. Ekenel, M. Kelepir, H.M. Meral, A.S. Ozsoy, O. Sayli, O. Turk, B. Yolcu, "Acoustic Analysis of Turkish Sounds", In Proc. of 12th International Conference on Turkish Linguistics (ICTL 2004), Izmir, Turkey, August 11-13, 2004.
• H.K. Ekenel, S.Y. Bilgin, I. Eden, M. Kirisci, H. Erdogan, A. Ercil, "Multimodal Person Verification from Video Sequences", Special Workshop in Maui (SWIM): Lectures by Masters in Speech Processing, Maui, Hawaii, January 12-14, 2004.

Publications in Turkish

• H.M. Meral, H.K. Ekenel, A.S. Ozsoy, "Analysis of Emotion in Turkish", XVII. National Conference on Turkish Linguistics, Eskisehir, Turkey, May 2003.
• H.K. Ekenel, B. Sankur, "ICA/PCA Feature Selection for Face Recognition", IEEE Signal Processing and Communications Applications Conference, Istanbul, Turkey, June 2003.
• H.K. Ekenel, B. Sankur, "Face Recognition Using Multiresolution Analysis", IEEE Signal Processing and Communications Applications Conference, Istanbul, Turkey, June 2003.
• G. Akgun, H.K. Ekenel, A. Ercil, "A Robust Object Recognition and Pose Estimation System", IEEE Signal Processing and Communications Applications Conference, Istanbul, Turkey, June 2003.
• H.K. Ekenel, H.M. Meral, A.S. Ozsoy, "Emotion Analysis from the Intonation Patterns", IEEE Signal Processing and Communications Applications Conference, Istanbul, Turkey, June 2003.
• H.K. Ekenel, M.L. Arslan, A.S. Ozsoy, "Analysis and Modeling of Turkish Intonation", XVI. National Conference on Turkish Linguistics, Ankara, Turkey, May 2002.
• H.K. Ekenel, M.L. Arslan, A.S. Ozsoy, "Intonation Analysis for Turkish Text-to-Speech Synthesis", IEEE Signal Processing and Communications Applications Conference, Pamukkale, Turkey, June 2002.