Sergey Tulyakov

CURRICULUM VITAE

January, 25, 2019

CUBS, 113 Davis Hall
University at Buffalo, Amherst, NY 14260-2500
Phone: (716) 645-1564
E-mail: tulyakov@buffalo.edu
http://www.buffalo.edu/~tulyakov/

Education:


2000-2006: PhD program in the Department of Computer Science and Engineering. Dissertation topic: "A Complexity Framework for Combination of Classifiers in Verification and Identification Systems". Defense date: March 2006.

1998-2000: M.Sc. program at the Department of Computer Science and Engineering. Degree received in May 2000.

1995-2000: Ph.D. program at the Department of Mathematics in SUNY at Buffalo.

1993-1995: Graduate program in Mathematics in Moscow State University. Passed qualifying examinations for the degree of candidate of physical and mathematical sciences.

1988-1993: Moscow State University, Department of Mechanics and Mathematics. Degree with honors in pure and applied mathematics. Thesis: Invariant means on locally compact amenable groups.

Work Experience:


2001-present: Research Scientist at Center for Excellence in Document Analysis and Recognition (CEDAR) and Center for Unified Biometrics and Sensors (CUBS), SUNY at Buffalo. Job includes research projects on character and word recognition, improving mail address reading program for USPS and United Kingdom, research on automatic fingerprint identification and face recognition.

1999-2001: Research Assistant at Center for Excellence in Document Analysis and Recognition (CEDAR), SUNY at Buffalo. Job includes projects on digit, zip code and word recognition. Neural network is used as one of classifiers. The job requires reading and understanding of existing code, extensive testing and debugging, deep knowledge of pattern recognition algorithms.

May-August, 1998: Research Assistant at Center for Excellence in Document Analysis and Recognition (CEDAR), SUNY at Buffalo. Job included documenting and testing of handwritten word recognition program.

1995-1999: Teaching assistant at the Department of Mathematics, SUNY at Buffalo.

1992-1994: Part time job as programmer at Institute of System Research, Moscow. Job included development of a program for estimating roots of complex polynomials.

Research Projects:

  • Fusion of face recognizers (part of IARPA Janus). A variety of fusion techniques have been investigated in this project: score and feature vector level fusion, multi-frame fusion, stratified fusion, score normalization, fusion with quality measures.

  • Secure Biometric Indexing. This project explores the possibility of using privacy preserving biometric templates in indexing structure. Both theoretical and practical issues of such systems are explored in the research.

  • Person tracking in mobile 3D environment. Using video from wearable cameras, the system constructs a model of 3D environment. The estimated positions of persons in this model are subsequently coupled with person recognition module in a tracking system.

  • Facial expression biometrics. This project explores the possibility of identifying people by the way they express their emotions. The experiments confirm that geometric facial expression features can indeed help in identifying persons.

  • Fingerprint indexing system. This project explores the possibility of indexing fingerprints using minutia positions. In contrast to previous minutia indexing approaches, we construct a true index tree structure using local minutia neighborhood information. The system is expected to deliver a superior fingerprint matching time in identification systems.

  • Classifier combination in biometric identification systems. I developed a general framework for classifier combination defining 4 types of combinations. Theory and experimental results show that combinations of most frequently used combination type provide only suboptimal performance. The combinations of another type deliver better performance in biometric systems. This project constitutes major part of my Ph.D. thesis research.

  • Classifier combination project. I investigate the error properties of the combination of biometric and handwritten word recognizers. The dependency of the optimal combination algorithm and its performance on the number of enrolled templates is also been studied.

  • Secure fingerprint matching. I developed a unique algorithm for hashing fingerprint minutia information and matching hashed fingerprints. Only hash information is stored in the database and it is impossible to recover original fingerprints. Algorithm has good performance, and more effort is being applied to improve and expand it.

  • Barcode printing and recognition tools. Implemented 4-state barcode printing and recognition capabilities, and multiple interface changes.

  • Automatic fingerprint identification system - three layer client-server application. Developed and implemented access to multiple databases through ODBC interface, most of the server functions, some communication (DCOM) and client functions. Participated in the design of the whole system and database. The system is currently being deployed in some US locations.

  • Barcode evaluation project. I supervised the project and implemented most of the software for this project, including implementation of CRC, Reed-Solomon and convolutional encoders and decoders. The results serve as a basis for barcode standard adoption by USPS.

  • United Kingdom Address Interpretation (UKAI) project. Improved handwritten word and phrase recognition by training and combining word recognizers, and by implementing additional features. Implemented character segmentation module for postal code.

  • Handwritten Address Interpretation (HWAI) project. Developed multiple improvements to the handwritten word recognition module. Also developed efficient address block location module based on the contour clustering.

Teaching Experience:

Biometrics & Image Analysis (Fall 2014, Spring 2019) - Instructor
Biometrics & Image Analysis (2006-2013), Pattern Recognition (Fall 2003) - presented series of lectures, directed student's projects.
Calculus (Summer 1999) - Instructor
Miscellaneous undergraduate courses in mathematics (1995-1999) - Teaching Assistant

Professional Service:

IEEE Biometrics Compendium: Associate Editor
SPIE Journal of Electronic Imaging: Associate Editor

Reviewer for:

IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Systems, Man and Cybernetics
IEEE Transactions on Image Processing
Pattern Analysis and Applications Journal
International Journal of Pattern Recognition and Artificial Intelligence
EURASIP Journal on Advances in Signal Processing
International Workshop on Multiple Classifier Systems (MCS 2004, 2005, 2009, 2010, 2011)
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2004, 2005, 2006, 2013)
International Conference on Document Analysis and Recognition (ICDAR 2005, 2007)
International Conference on Biometrics (ICB 2007, 2013, 2016, 2018)
International Conference on Biometrics: Theory, Applications, and Systems (BTAS 2007, 2008, 2009, 2010, 2012, 2016, 2018)
International Joint Conference on Biometrics (IJCB 2011, 2017)
International Conference on Pattern Recognition (ICPR 2008, 2010, 2014, 2016)

Conference Presentations:

IEEE Conference on Biometrics: Theory, Applications and Systems (2007,2008)
SPIE Defense and Security Symposium (DSS) (2007)
IEEE Computer Society Workshop on Biometrics in association with CVPR (2006,2007,2012)
International Workshop on Multiple Classifier Systems (2005)
Biometrics Consortium Conference (2004)

Patents:

"Secure fingerprint matching by hashing localized information." Patent US 8005277.

Publications:

  1. S. Tulyakov, N. Sankaran, S. Setlur, and V. Govindaraju, "Utilizing Template Diversity for Fusion Of Face Recognizers," in IEEE International Conference on Identity, Security and Behavior Analysis (ISBA2019), 2019.

  2. N. Sankaran, S. Tulyakov, S. Setlur, and V. Govindaraju, "Metadata-based Feature Aggregation Network for Face Recognition," in International Conference on Biometrics (ICB 2018), 2018.

  3. R. R. Nair, N. Sankaran, B. U. Kota, S. Tulyakov, S. Setlur, and V. Govindaraju, "Knowledge Transfer Using Neural Network Based Approach for Handwritten Text Recognition," in 2018 13th IAPR International Workshop on Document Analysis Systems (DAS), 2018, pp. 441-446.

  4. S. Tulyakov, N. Sankaran, S. Setlur, and V. Govindaraju, "Score Normalization in Stratified Biometric Systems," in International Joint Conference on Biometrics (IJCB2017), 2017.

  5. J. Hartloff, M. Morse, B. Zhang, T. Effland, J. Cordaro, J. Schuler, S. Tulyakov, A. Rudra, and V. Govindaraju, "A multiple server scheme for fingerprint fuzzy vaults," in 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015, pp. 119-127.

  6. S. Tulyakov and V. Govindaraju, "Handprinted Character and Word Recognition," in Handbook of Document Image Processing and Recognition, D. Doermann and K. Tombre, Eds.: Springer London, 2014, pp. 359-389.

  7. J. Li, S. Tulyakov, and V. Govindaraju, "Improved Local Correlation Method for Fingerprint Matching," in Computing and Networking (CANDAR), 2014 Second International Symposium on, 2014, pp. 560-562.

  8. M. Morse, J. Hartloff, T. Effland, J. Schuler, J. Cordaro, S. Tulyakov, A. Rudra, and V. Govindaraju, "Secure Fingerprint Matching with Generic Local Structures," in Computer Vision and Pattern Recognition Workshops (CVPRW), 2014 IEEE Conference on, 2014, pp. 84-89.

  9. T. Effland, M. Schneggenburger, J. Schuler, B. Zhang, J. Hartloff, J. Dobler, S. Tulyakov, A. Rudra, and V. Govindaraju, "Secure fingerprint hashes using subsets of local structures," in Proc. SPIE 9075, Biometric and Surveillance Technology for Human and Activity Identification XI, 2014, pp. 90750D-90750D-17.

  10. S. Tulyakov and V. Govindaraju, "Matching Score Fusion Methods," in Handbook of Statistics. vol. 31, C. R. Rao and G. Venu, Eds.: Elsevier, 2013, pp. 151-175.

  11. S. P. Satheesan, S. Tulyakov, and V. Govindaraju, "A feature information based approach for enhancing score-level fusion in multi-sample biometric systems," in Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), 2013 Fourth National Conference on, 2013.

  12. J. Hartloff, J. Dobler, S. Tulyakov, A. Rudra, and V. Govindaraju, "Towards Fingerprints as Strings: Secure Indexing for Fingerprint Matching," in International Conference on Biometrics (ICB 2013), 2013.

  13. X. Cheng, S. Tulyakov, and V. Govindaraju, "Minutiae-based Matching State Model for Combinations in Fingerprint Matching System," in Computer Vision and Pattern Recognition Workshops (CVPRW), 2013 IEEE Computer Society Conference on, 2013.

  14. J. Hartloff, M. Bileschi, S. Tulyakov, J. Dobler, A. Rudra, and V. Govindaraju, "Security analysis for fingerprint fuzzy vaults," in SPIE Defense, Security and Sensing Symposium (DSS), Baltimore, MD, USA, 2013.

  15. Cheng, X., Tulyakov, S., and Govindaraju, V.: Utilization of Matching Score Vector Similarity Measures in Biometric Systems, in Computer Vision and Pattern Recognition Workshops (CVPRW), 2012 IEEE Computer Society Conference on. 2012.

  16. Kashyap, A.L., Tulyakov, S., Govindaraju, V.: Facial Behavior as a Soft Biometric. International Conference on Biometrics (ICB 2012), 2012.

  17. Tulyakov, S. and V. Govindaraju, Predicting Performance in Large-Scale Identification Systems by Score Resampling, in Multibiometrics for Human Identification, B. Bhanu and V. Govindaraju, Editors. 2011, Cambridge University Press. p. 363-388.

  18. Cheng, X., S. Tulyakov, and V. Govindaraju. Combination of Multiple Samples Utilizing Identification Model in Biometric Systems. in International Joint Conference on Biometrics (IJCB2011). 2011. Washington, USA.

  19. Cheng, X., S. Tulyakov, and V. Govindaraju. Multiple-sample fusion of matching scores in biometric systems. in Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on. 2011.

  20. Cheng, X., S. Tulyakov, and V. Govindaraju. Combination of user- and enrollee-specific statistical information in verification systems. in Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on. 2011.

  21. Tulyakov, S., C. Wu, and V. Govindaraju, On the Difference Between Optimal Combination Functions for Verification and Identification Systems. International Journal of Pattern Recognition and Artificial Intelligence, 2010. 24(2): p. 173-191.

  22. Mansukhani, P., S. Tulyakov, and V. Govindaraju, A Framework for Efficient Fingerprint Identification Using a Minutiae Tree. Systems Journal, IEEE, 2010. 4(2): p. 126-137.

  23. Kumar, G., S. Tulyakov, and V. Govindaraju. Combination of Symmetric Hash Functions for Secure Fingerprint Matching. in International Conference on Pattern Recognition (ICPR 2010). 2010.

  24. Tulyakov, S. and V. Govindaraju. Predicting Performance in Large-Scale Identification Systems by Score Resampling. in International Biometric Performance Conference (IBPC 2010). 2010.

  25. Zhang, Z., S. Tulyakov, J. Li, and V. Govindraju. Combining Facial Skin Mark and Eigenfaces for Face Recognition. in International Conference on Biometrics. 2009.

  26. Tulyakov, S. and V. Govindaraju. Neural Network Optimization for Combinations in Identification Systems. in Multiple Classifier Systems, 8th International Workshop, MCS 2009. 2009. Reykjavik, Iceland: Springer.

  27. Tulyakov, S. and V. Govindaraju, Use of Identification Trial Statistics for Combination of Biometric Matchers. Information Forensics and Security, IEEE Transactions on, 2008. 3(4): p. 719-733.

  28. Tulyakov, S. and V. Govindaraju, Issues and Advances in Biometrics, in Information Assurance, Security and Privacy Services, H.R. Rao and S.Upadhyaya, Editors. 2009, Emerald.

  29. Li, J., S. Tulyakov, F. Farooq, J. Corso, and V. Govindraju. Integrating minutiae based fingerprint matching with local mutual information. in International Conference on Pattern Recognition. 2008.

  30. Tulyakov, S., J. Li, and V. Govindraju. Enrolled Template Specific Decisions and Combinations in Verification Systems. in IEEE Second International Conference on Biometrics: Theory, Applications and Systems (BTAS 08). 2008.

  31. Li, J., S. Tulyakov, Z. Zhang, and V. Govindraju. Fingerprint Matching Using Correlation and Thin-Plate Spline Deformation Model. in IEEE Second International Conference on Biometrics: Theory, Applications and Systems (BTAS 08). 2008.

  32. Tulyakov, S., Z. Zhang, and V. Govindaraju. Comparison of Combination Methods Utilizing T-normalization and Second Best Score Model. in CVPR 2008 Workshop on Biometrics. 2008.

  33. Tulyakov, S., F. Farooq, P. Mansukhani, and V. Govindaraju, Symmetric hash functions for secure fingerprint biometric systems. Pattern Recognition Letters, 2007. 28(16): p. 2427-2436.

  34. Tulyakov, S., C. Wu and V. Govindaraju. Iterative Methods for Searching Optimal Classifier Combination Function. in Biometrics: Theory, Applications, and Systems, 2007.

  35. Li, J., S. Tulyakov, and V. Govindaraju. Verifying Fingerprint Match by Local Correlation Methods. in Biometrics: Theory, Applications, and Systems, 2007.

  36. Wu, C., S. Tulyakov, and V. Govindaraju. Robust Point-Based Feature Fingerprint Segmentation Algorithm. in International Conference on Biometrics. 2007.

  37. Tulyakov, S., T. Slowe, Z. Zhang, and V. Govindaraju. Facial Expression Biometrics Using Tracker Displacement Features. in CVPR 2007 Workshop on Biometrics. 2007.

  38. Zhang, Z., T. Slowe, V. Singh, S. Tulyakov, and V. Govindaraju. Real-time Automatic Deceit Detection from Involuntary Facial Expressions. in CVPR 2007 Workshop on Biometrics.

  39. Tulyakov, S., S. Jaeger, V. Govindaraju, and D. Doermann, Review of Classifier Combination Methods, in Learning in Document Analysis and Recognition, S. Marinai and H. Fujisawa, Editors. 2007, Springer.

  40. Tulyakov, S. and V. Govindaraju, Learning matching score dependencies for classifier combination, in Learning in Document Analysis and Recognition, S. Marinai and H. Fujisawa, Editors. 2007, Springer.

  41. Tulyakov, S., V. Govindaraju, and C. Wu. Optimal Classifier Combination Rules for Verification and Identification Systems. in 7th International Workshop on Multiple Classifier Systems. 2007. Prague, Czech Republic.

  42. Mansukhani, P., S. Tulyakov, and V. Govindaraju. Using Support Vector Machines to eliminate False Minutiae Matches during Fingerprint Verification. to appear in SPIE Defense and Security Symposium (DSS). 2007. Orlando, FL., USA.

  43. Tulyakov, S. and V. Govindaraju. Identification Model for Classifier Combinations. in Biometrics Consortium Conference. 2006. Baltimore, MD.

  44. Tulyakov, S. and V. Govindaraju. Utilizing Independence of Multimodal Biometric Matchers. in International Workshop on Multimedia Content Representation, Classification and Security. 2006. Istanbul, Turkey.

  45. Wu, C., S. Tulyakov, and V. Govindaraju. Image Quality Measures for Fingerprint Image Enhancement. in International Workshop on Multimedia Content Representation, Classification and Security. 2006. Istanbul, Turkey.

  46. Tulyakov, S. and V. Govindaraju. Classifier Combination Types for Biometric Applications. in IEEE Computer Society Workshop on Biometrics. 2006. New York.

  47. Tulyakov, S. and V. Govindaraju. Identification Model with Independent Matching Scores. in Biometrics Consortium Conference. 2005. Crystal City, VA.

  48. Tulyakov, S., F. Farooq, and V. Govindaraju. Symmetric Hash Functions for Fingerprint Minutiae. in International Workshop on Pattern Recognition for Crime Prevention, Security and Surveillance. 2005. Bath, UK.

  49. Tulyakov, S. and V. Govindaraju. Combining Matching Scores in Identification Model. in 8th International Conference on Document Analysis and Recognition (ICDAR 2005). 2005. Seoul, Korea.

  50. Tulyakov, S. and G. V. Using independence assumption to improve multimodal biometric fusion. in 6th International Workshop on Multiple Classifiers Systems (MCS2005). 2005. Monterey, USA: Springer.

  51. Chavan, V., S. Chikkerrur, S. Tulyakov and V. Govindaraju (2004). Securing Pervasive Networks using Biometrics. Secure Knowledge Management (SKM 2004), Buffalo, NY, USA.

  52. Tulyakov, S., V. Chavan and V. Govindaraju (2004). Symmetric Hash Functions for Fingerprint Minutiae. Biometrics Consortium Conference, Crystal City, VA.

  53. Govindaraju, V. and S. Tulyakov (2003). Postal address block location by contour clustering. 7th International Conference on Document Analysis and Recognition (ICDAR 2003), Edinburgh, Scotland, UK, IEEE Computer Society.

  54. Tulyakov, S. and V. Govindaraju (2001). Probabilistic Model for Segmentation Based Word Recognition with Lexicon. 6th International Conference on Document Analysis and Recognition (ICDAR 2001), Seattle, USA, IEEE Computer Society.

  55. Tulyakov, S. (1996). Ergodic property of space of functions with unique invariant mean value. Vestnik Moskovskogo Universiteta, Seriya 1 Matematika Mehanika (2): 8-13 Mar-Apr 1996.