18% men will go for plastic surgery in near future. • It is also estimated 29% white Americans and 31% non-white Americans will go for ethnic plastic surgery in near future. • Plastic surgery distribution by age: 0-18 years constitute 2% of the total procedures, 19-34 years constitute 22%, 35-50 years constitute 45%, 51-64 years constitute 26%, and 65 years and above constitute 6% of the total plastic surgery procedures. • 18% men and 23% women are now more affirmative towards plastic surgery than they were 5 years ago. The statistics clearly indicate the popularity of plastic surgery among all age groups, ethnicity and gender. Similar analysis from different countries illustrates the popularity of plastic surgery. These surgical procedures prove beneficial for patients suffering from structural or functional impairment of facial features, but these procedures can also be misused by individuals who are trying to conceal their identity with the intent to commit fraud or evade R. Singh, M. Vatsa, H.S. Bhatt, and S. Bharadwaj are with the Indraprastha Institute of Information Technology (IIIT) Delhi, India, e-mail: (rsingh, mayank, himanshub, samarthb)@iiitd.ac.in. A. Noore is with Lane Department of Computer Science and Electrical Engineering, West Virginia University, USA, email: afzel.noore@mail.wvu.edu. S. S. Nooreyezdan is with the Department of Plastic and Reconstructive Surgery, Indraprastha Apollo Hospital, Delhi, India law enforcement. These surgical procedures may allow anti-social elements to freely move around without any fear of being identified by any face recognition system. Plastic surgery, results being longlasting or even permanent, provide an easy and robust way to evade law and security mechanism. Sometimes, facial plastic surgery may unintentionally cause rejection of genuine users. A recent incidence in China accentuates the intricacies of this covariate. At Hongqiao International airport’s customs, a group of women were stopped as all of them had undergone facial plastic surgery and had become so unrecognizable that customs officers could not use their existing passport pictures to recognize them [2]. While face recognition is a well studied problem in which several approaches have been proposed to address the challenges of illumination [3], [4], pose [5], [6], [7], expression [4], aging [8], [9] and disguise [10], [11], the growing popularity of plastic surgery introduces new challenges in designing future face recognition systems. Since these procedures modify both the shape and texture of facial features to varying degrees, it is difficult to find the correlation between pre and post surgery facial geometry. To the best of our knowledge, there is no study that demonstrates any scientific experiment for recognizing faces that have undergone local or global plastic surgery. The major reasons for the problem not being studied are: • Due to the sensitive nature of the process and the privacy issues involved, it is extremely difficult to prepare a face database that contains images before and after surgery. • After surgery, the geometric relationship between facial features changes and there is no technique to detect and measure such type of alterations. The main aim of this paper is to add a new dimension to face recognition by discussing this challenge and systematically evaluating the performance of existing face recognition algorithms on a database that contains face images before and after surgery. The next section describes the types of plastic surgery that can affect the performance of face recognition systems. Section II presents a detailed description of different types of facial plastic surgery and Section III presents an analytical study of plastic surgery on face recognition including an experimental evaluation of six face recognition algorithms using a facial plastic surgery database of 900 individuals. Finally, Section IV discusses ethical and engineering challenges in this research domain. II. TYPES OF FACIAL PLASTIC SURGERY When an individual undergoes plastic surgery, the facial features are reconstructed either globally or locally. Therefore, in general, plastic surgery can be classified into two distinct categories. • Disease correcting local plastic surgery (Local surgery): This is a kind of surgery in which an individual undergoes local plastic surgery for correcting defects, anomalies, or improving skin texture. Local plastic surgery techniques can be applied for possibly three different purposes: 1) to correct by-birth anomalies, 2) to cure the defects that are result of some accident, and 3) to correct the anomalies that have developed over the years. Examples of disease correcting local plastic surgery would be surgery for correcting jaw and teeth structure, nose structure, chin, forehead and eyelids etc. Local plastic surgery is also SUBMITTED TO IEEE TIFS 2 aimed at reshaping and restructuring facial features to improve the aesthetics. This type of local surgery leads to varying amount of changes in the geometric distance between facial features but the overall texture and appearance may look similar to the original face. However, any of the local plastic surgery procedures may be performed in conjunction with one or more such procedures and an amalgamate of such procedures may result in a fairly distinct face when compared to the original face. • Plastic surgery for reconstructing