Photo: nappy

How can I check my face attractiveness?

learnopencv.com - Computer Vision for Predicting Facial Attractiveness - LearnOpenCV

What are some flirty things to say?

Flirty texts for him Y/N: Thinking about me? Feeling cuddly? ... Still wearing your sweatshirt… Netflix? ... Can't stop thinking about your lips....

Last updated Feb 1, 2020

What age do men's sperm stop working?

Although men never stop producing sperm throughout their lives, sperm production does begin decreasing after age 35. Motility, volume and genetic...

Last updated Jun 14, 2022

Promotion

Most of us have looked in the mirror and wondered how good we look. But, it is often difficult to be objective while judging our own attractiveness, and we are often too embarrassed to ask for others’ opinion. What if there was a computer program that could answer this question for you, without a human to look at your image? Pretty nifty, huh?

In this post, I will show you how we can use computer vision and machine learning to predict facial attractiveness of an individual from a single photograph. I will use OpenCV, Numpy and scikit-learn to develop a completely automated pipeline that takes a photograph of a person’s face, and rates the photo on a scale of 1 to 5. The code is available at the bottom of this page. page to see all the cool projects he has done. This is a guest post by Avi Singh — an undergraduate student at Indian Institute of Technology, Kanpur. Visit histo see all the cool projects he has done. While applying machine learning algorithms to a computer vision problems, the high dimensionality of visual data presents a huge challenge. Even a relatively low-res 200×200 image translates to a feature vector of length 40,000. Deep learning models like Convolutional Neural Nets can work directly with raw images, but they require huge amounts of data to be successful. Since we only have a access to a small-ish dataset in this tutorial (500 images), we cannot work with raw images, and we therefore need to extract some informative features from these images. I’ve partnered exclusively with OpenCV.org to bring you official courses in AI, Computer Vision, and Deep Learning to take you on a structured path from first steps to mastery. Learn More

Feature Extraction for Facial Attractiveness

One feature that determines facial attractiveness (as cited in psychology literature), is the ratio of the distances between the various facial landmarks. Facial landmarks are features like the corner of the eyes, tip of the nose, lowest point on the chin, etc. You can see these points marked in red on the image at the top of this page. In order to calculate these ratios, we would need to have an algorithm with can localize the landmarks accurately in an image. In this post, we would be making use of an open-source software called the CLM framework to extract these landmarks. It is written in C++, and utilizes OpenCV 3.0. It has instructions for both Windows and Ubuntu (which should also work with OS X without much change), and works out of the box. If you do not want to bother with setting up this piece of software, I will be providing a file with facial landmark coordinates of all the images that I use in this tutorial, and you can then tinker with the Machine Learning part of the pipeline.

Facial Attractiveness Dataset

Which woman has the most beautiful face?

"Jodie Comer was the clear winner when all elements of the face were measured for physical perfection. She had the highest overall reading for the...

Last updated Nov 27, 2020

What is the difference between soul and spirit?

Our soul is reflected in our personality. The Greek word for spirit is pneuma. It refers to the part of man that connects and communicates with...

Last updated Sep 7, 2020

Promotion

Now that we have a way to extract features, what we need now is the data to extract these features from. While there are several datasets available to benchmark facial attractiveness, most of them require signing up, and won’t be available to people outside the academia. However, I was able to find one dataset that does not have these requirements. It is called the SCUT-FBP dataset, and contains images of 500 Asian females. Each image is rated by 10 users, and we would be attempting to predict the average rating for each image.

Generating Features

We first run the CLM-framework on these images and write the facial landmarks to a file. Click here to get the file. Next we use a python script to calculate ratios between all possible pairs of points, and save the results to a text file. Now that we have our features, we can finally delve into Machine Learning!

Machine Learning for Rating a Face

While there are numerous packages available for Machine Learning, I chose to go with scikit-learn in this post because it’s easy to install and use. Installing scikit-learn is as simple as:

Ubuntu

sudo apt-get install python-sklearn

Mac OSX

pip install -U numpy scipy scikit-learn

Windows

pip install -U scikit-learn

For more details, you can visit the official scikit-learn installation page.

Once you are past the installation, you will notice that working with scikit-learn is a walk in the park. Follow these instructions to load the data (both features and ratings): Download Code To easily follow along this tutorial, please download code by clicking on the button below. It's FREE! To easily follow along this tutorial, please download code by clicking on the button below. It's FREE!

import numpy as np features = np.loadtxt('features_ALL.txt', delimiter=',') ratings = np.loadtxt('labels.txt', delimiter=',')

Now, if you open the features file, you will see that the number of features per image are extremely large (for the size of our dataset), and if we directly use them, we will face a problem called the Curse of Dimensionality. What we need is to project this large feature space into a smaller feature space, and the algorithm to do so is Principal Component Analysis (PCA). Using PCA in scikit-learn is pretty simple, and the following code is all you need: from sklearn import decomposition pca = decomposition.PCA(n_components=20) pca.fit(features_train) features_train = pca.transform(features_train) features_test = pca.transform(features_test) In the above code, n_components is a hyper-parameter, and it’s value can be chosen by testing the performance of the model on a validation set (or cross-validation). Now we need to choose what model we should use for our problem. Our problem is a regression problem. There are several models/algorithms available to deal with these problem like Linear Regression, Support Vector Regressors (SVR), Random Forest Regression, Gaussian Process Regression, et all. Let’s have a look at the code that we need to train a linear model:

Is it a sin to touch your boyfriend?

Sex is covenantal. If you're not married, any sexual activity (oral sex, sexual touching or fondling, etc.) is a sin, for the only person you're to...

Last updated Feb 24, 2020

How much money do you get on TikTok for 1 million likes?

It's estimated that the creator fund pays around 2 to 4 cents per 1,000 views. How much money does one million TikTok views make? A creator who...

Last updated Mar 12, 2020

Promotion

regr = linear_model.LinearRegression() regr.fit(features_train, ratings_train) ratings_predict = regr.predict(features_test)

The above code will fit a linear regressor on the traininng set, and then store the predictions. The next step in our pipeline is to do performance evaluation. One way to do so is to calculate the Pearson correlation between the predicted ratings and the actual ratings. This can be calculated using Numpy as shown below

corr = np.corrcoef(ratings_predict, ratings_test)[0, 1]

Results

One thing that I have not talked about so far is how I split the dataset into training and testing. To get the initial results, I used a split of 450 training images and 50 testing images. But, since we have very limited data, we should try to make use of as much data as possible to train the model. One way to do so is leave-one-out cross-validation. In this technique, we take 499 images for training, and then test the model on the one image that we left out. We do this for all 500 images (train 500 models), and then calculate the Pearson correlation between the predictions and the actual ratings. The graphic below highlights the performance obtained when I evaluated several models using this method. Linear Regression and Random Forest perform the best, with a Pearson correlation of 0.64 each. K-Nearest Neighbors is comparable with 0.6, while Gaussian Process regression lags a bit at 0.52. SVM perform really poorly, which was somewhat of a surprise for me.

Testing on Celebrities

Yoona, Predicted Rating: 3.6

Yuri, Predicted Rating: 3.4

Tiffany, Predicted Rating: 3.8

Now, let us have some fun, and use the model that we just trained on some celebrity photographs! I am personally a fan of the K-pop group Girls’ Generation, and since the training images in the dataset are all asian females, the singers of Girls’ Generations are ideal for our experiment! As one might expect, the predicted ratings are quite high (the average was 2.7 in the training set). This shows that the algorithms generalizes well, at least for faces of the same gender and ethnicity. There are a lot of things that we could do to improve the performance. The present algorithm takes into account only the shape of the face. Some other important features might be skin gradients and hair style, which I have not modeled in this post. Perhaps a future approach can use pre-trained Convolutional Neural Nets to extract high level features, and then something like an Random Forest or an SVM at the top can do the regression.

learnopencv.com - Computer Vision for Predicting Facial Attractiveness - LearnOpenCV

What makes a face handsome?

Wide eyes, full cheeks, and a refined nose are essential features of a good looking face. However, facial beauty is more than the sum of these...

Last updated May 20, 2018

How can you tell the difference between a karmic and twin flame?

“The key difference is that a twin flame will trigger a spiritual awakening, and you cannot cut the connection with a twin flame.” As Mystic...

Last updated Apr 26, 2021

Promotion

Which God married his own daughter?

Lord Brahma Answer is here : Yes, Lord Brahma married his own daughter. Mar 22, 2022

Last updated Dec 25, 2020

Promotion

What is the hardest phase of marriage?

According to relationship therapist Aimee Hartstein, LCSW, as it turns out, the first year really is the hardest—even if you've already lived...

Last updated May 18, 2020