Real-Time Smile Detection OpenCV Python With Source Code
The Real-Time Smile Detection OpenCV Python was developed using Python OpenCV, In this article, we are going to build a smile detector using OpenCV which takes in a live feed from a webcam.
The smile/happiness detector that we are going to implement would be a raw one, there exist many better ways to implement it.
A Smile Detection OpenCV Python face data is stored as tuples of coordinates. Here, x and y define the coordinate of the upper-left corner of the face frame, and w and h define the width and height of the frame.
The cv2.rectangle the function takes in the arguments frame, upper-left coordinates of the face, lower-right coordinates, the RGB code for the rectangle (that would contain within it the detected face), and the thickness of the rectangle.
The roi_gray defines the region of interest of the face and roi_color does the same for the original frame.
In this Real-Time Smile Detection OpenCV also includes a downloadable Project With Source Code for free, just find the downloadable source code below and click to start downloading.
By the way, if you are new to Python programming and don’t know what Python IDE to use, I have here a list of the Best Python IDE for Windows, Linux, and Mac OS that will suit you.
I also have here How to Download and Install the Latest Version of Python on Windows.
To start executing Real-Time Smile Detection OpenCV Python With Source Code, make sure that you have installed Python 3.9 and PyCharm on your computer.
Real-Time Smile Detection OpenCV Python With Source Code: Steps on how to run the project
Time needed: 5 minutes
These are the steps on how to run Real-Time Smile Detection OpenCV Python With Source Code
- Step 1: Download the given source code below.
First, download the given source code below and unzip the source code.
- Step 2: Import the project to your PyCharm IDE.
Next, import the source code you’ve downloaded to your PyCharm IDE.
- Step 3: Run the project.
Lastly, run the project with the command “py main.py”
Installed Libraries
import cv2
Complete Source Code
import cv2
# Load the cascade
face_cascade = cv2.CascadeClassifier('haarcascade_frontalface_default.xml')
eye_cascade = cv2.CascadeClassifier('haarcascade_eye.xml')
smile_cascade = cv2.CascadeClassifier('haarcascade_smile.xml')
#faces = face_cascade.detectMultiScale(gray, 1.3, 5)
def detect(gray, frame):
faces = face_cascade.detectMultiScale(gray, 1.3, 5)
for (x, y, w, h) in faces:
cv2.rectangle(frame, (x, y), ((x + w), (y + h)), (255, 0, 0), 2)
roi_gray = gray[y:y + h, x:x + w]
roi_color = frame[y:y + h, x:x + w]
smiles = smile_cascade.detectMultiScale(roi_gray, 1.8, 20)
for (sx, sy, sw, sh) in smiles:
cv2.rectangle(roi_color, (sx, sy), ((sx + sw), (sy + sh)), (0, 0, 255), 2)
return frame
video_capture = cv2.VideoCapture(0)
while True:
# Captures video_capture frame by frame
_, frame = video_capture.read()
# To capture image in monochrome
gray = cv2.cvtColor(frame, cv2.COLOR_BGR2GRAY)
# calls the detect() function
canvas = detect(gray, frame)
# Displays the result on camera feed
cv2.imshow('Video', canvas)
# The control breaks once q key is pressed
if cv2.waitKey(1) & 0xff == ord('q'):
break
# Release the capture once all the processing is done.
video_capture.release()
cv2.destroyAllWindows()
Output:
Download the Source Code below
Summary
Emotion detectors are used in many industries, one being the media industry where it is important for the companies to determine the public reaction to their products.
In this article, we are going to build a smile detector using OpenCV which takes in a live feed from a webcam.
The smile/happiness detector that we are going to implement would be a raw one, there exist many better ways to implement it.
Related Articles
- Code For Game in Python: Python Game Projects With Source Code
- Best Python Projects With Source Code FREE DOWNLOAD
- How to Make a Point of Sale In Python With Source Code
- Python Code For Food Ordering System | FREE DOWNLOAD
- Inventory Management System Project in Python With Source Code
Inquiries
If you have any questions or suggestions about Real-Time Smile Detection OpenCV Python With Source Code, please feel free to leave a comment below.
Technology stack and requirements
To run this Python project on your development machine, you need:
- Python 3.10 or higher. Download from python.org or install via Anaconda if you prefer bundled packages.
- pip package manager. Comes with Python. Used to install project dependencies from requirements.txt.
- Virtual environment. Use venv or conda to isolate project dependencies from your global Python install.
- VS Code or PyCharm. Free code editors with Python syntax highlighting, IntelliSense, and debugging.
- Git. For version control and cloning source code repositories.
Installing the source code
- Download or clone the repository. Get the ZIP archive from the download link on this page and extract it.
- Create a virtual environment. Open a terminal in the project folder and run: python -m venv venv, then activate it (venv\Scripts\activate on Windows or source venv/bin/activate on Mac/Linux).
- Install dependencies. Run pip install -r requirements.txt to install all libraries the project needs.
- Configure environment variables. If the project uses API keys (OpenAI, Anthropic, database), create a .env file and set the required keys.
- Run the project. Follow the run command in the README (usually python main.py or streamlit run app.py).
Using this project for your BSIT capstone
- Chapter 1 (Introduction). Discuss the real-world problem this system solves. Cite Philippine or international use cases where the manual process could be automated.
- Chapter 2 (RRL). Compare your project against 5-10 similar published works. Cite ACM, IEEE, or arXiv papers for academic-standard sources.
- Chapter 3 (Methodology). Document the model architecture, training data, hyperparameters, and evaluation metrics used.
- Chapter 4 (Results). Report accuracy, precision, recall, F1-score, and confusion matrix. Screenshot the running app on real inputs.
- Chapter 5 (Conclusion). Identify features for Version 2: better model, larger dataset, mobile deployment, or REST API.
Modules typical of Real-Time Smile Detection using OpenCV Python
- Image dataset preparation. Train/val/test split, augmentation (rotation, flip, brightness).
- Model architecture. Pre-trained CNN (ResNet, EfficientNet) fine-tuned on your dataset.
- Training loop. PyTorch or TensorFlow/Keras training with early stopping and checkpoints.
- Evaluation. Confusion matrix, precision, recall, and per-class F1 scores.
- Inference API. FastAPI endpoint accepting image uploads and returning predictions.
- Web or mobile demo. Streamlit or React front-end for user interaction.
Common enhancements for capstone review
- Grad-CAM visualization. Show which pixels the model focused on when making a prediction.
- Data augmentation. Increase training data variety with imgaug or Albumentations library.
- Transfer learning benchmark. Compare training-from-scratch vs fine-tuning pre-trained models.
- Model quantization. Convert to TensorFlow Lite for mobile deployment.
Official documentation
Frequently Asked Questions
How does real-time smile detection work?
Stack two Haar classifiers: first detect faces with haarcascade_frontalface_default.xml, then run haarcascade_smile.xml within each face region of interest. A detected smile inside a face region triggers a positive. Tune scaleFactor and minNeighbors parameters to control sensitivity (smaller scaleFactor catches subtle smiles; higher minNeighbors reduces false positives).
What Python and library versions do I need?
Python 3.10, 3.11, or 3.12 (avoid 3.13 until all DL wheels catch up). Install with: pip install opencv-python numpy. For deep learning models add: tensorflow keras (CPU build is fine for most demos), torch torchvision (PyTorch alternative), mediapipe (for face/hand/pose). Some projects also need: pytesseract for OCR, pyzbar for barcode, dlib for legacy face-landmark predictor.
Do I need a GPU to run this deep learning project?
For inference on a pretrained model: no, CPU runs at 10-30 FPS for most computer-vision tasks. For TRAINING a custom model: GPU strongly recommended (CPU works but slow). Free GPU options for training: Google Colab Free (12-hour sessions, sufficient for most BSIT capstones), Kaggle Notebooks Free. Buying a $1000+ GPU just for capstone is overkill.
Can I use this deep learning project for a BSIT or CSE capstone?
Yes, but extend it. A single OpenCV deep-learning demo (face detection, object detection alone) is too narrow for full capstone scope. Combine with a real domain wrapper: an attendance system using face recognition, a traffic monitoring system using vehicle detection, a wildlife camera using object detection, a driver-monitoring app using drowsiness detection. Add database logging, simple UI, and Chapter 1-5 manuscript.
Why does my model give wrong predictions or low accuracy?
Three most common causes: (1) Input preprocessing mismatch: the model expects 224×224 RGB normalized to [0,1] or [-1,1]; using BGR (OpenCV default) or wrong size produces garbage. (2) Insufficient training data: if you trained your own model on under 1,000 samples per class, accuracy plateaus low. Augment with cv2.flip, rotate, brightness shifts. (3) Lighting and angle drift between training and live use: train on data that matches the deployment environment.
Where can I find more deep learning project ideas with source code?
Browse our Deep Learning Projects hub for 19+ vision demos. For broader AI / ML / RAG / NLP capstones see 100+ AI Capstone Project Ideas. For pure ML (no deep learning) see Machine Learning Projects.
Angel Jude Suarez
Full-Stack Developer at PIES IT Solution
Focuses on Python development, machine learning, and AI integration. Has built production AI systems including OpenAI Whisper integration for medical transcription and GPT-4o-powered diagnosis assistance. Strong background in pandas, scikit-learn, and TensorFlow.
Expertise: Python · PHP · Java · VB.NET · ASP.NET · Machine Learning · AI Integration · OpenCV · Django · CodeIgniter
· View all posts by Angel Jude Suarez →