Real-Time Face Landmark Detection using OpenCV in Python

The Real-Time Face Landmark Detection OpenCV Python was developed using Python OpenCV, Face detection is a computer technology being used in a variety of applications that identify human faces in digital images.

Face detection also refers to the psychological process by which humans locate and attend to faces in a visual scene.

A Face Landmark Detection OpenCV Python is the process of detecting landmarks or regions of interest (key points) on the face like Eyebrows, Eyes, Nose, and Mouth.

In this article, the system can detect the face of the human in real-time using a web camera.

About The Project

This OpenCV Python Project also includes a downloadable Python Project With Source Code for free, just find the downloadable source code below and click to start downloading.

By the way, if you are new to Python programming and don’t know what Python IDE to use, I have here a list of the Best Python IDE for Windows, Linux, and Mac OS that will suit you.

I also have here How to Download and Install the Latest Version of Python on Windows.

To start executing Real-Time Face Landmark Detection With Source Code, make sure that you have installed Python 3.9 and PyCharm on your computer.

How To Run The Face Landmark Detection using OpenCV Python With Source Code

Time needed: 5 minutes

These are the steps on how to run Real-Time Face Landmark Detection OpenCV Python With Source Code

  • Step 1: Download the given source code below.

    First, download the given source code below and unzip the source code.
    face landmarks detection download source code

  • Step 2: Import the project to your PyCharm IDE.

    Next, import the source code you’ve downloaded to your PyCharm IDE.
    face landmarks detection open project

  • Step 3: Run the project.

    Lastly, run the project with the command “py main.py”
    face landmarks detection run project

Installed Libraries

import cv2
import dlib

Complete Source Code

import cv2
import dlib

cap = cv2.VideoCapture(0)

hog_face_detector = dlib.get_frontal_face_detector()

dlib_facelandmark = dlib.shape_predictor("shape_predictor_68_face_landmarks.dat")

while True:
    _, frame = cap.read()
    gray = cv2.cvtColor(frame, cv2.COLOR_BGR2GRAY)

    faces = hog_face_detector(gray)
    for face in faces:

        face_landmarks = dlib_facelandmark(gray, face)

        for n in range(0, 16):
            x = face_landmarks.part(n).x
            y = face_landmarks.part(n).y
            cv2.circle(frame, (x, y), 1, (0, 255, 255), 1)


    cv2.imshow("Face Landmarks", frame)

    key = cv2.waitKey(1)
    if key == 50:
        break
cap.release()
cv2.destroyAllWindows()

Output:

Real Time Face Landmark Detection OpenCV Python With Source Code Output
Real-Time Face Landmark Detection OpenCV Python With Source Code Output

Download the Source Code below

Summary

In this article, Left Eye Detection OpenCV Python’s most successful application of eye detection would probably be photo taking.

When you take a photo of your friends, the eye detection algorithm built into your digital camera detects where the eyes are and adjusts the focus accordingly.

Related Articles

Inquiries

If you have any questions or suggestions about Real-Time Face Landmark Detection OpenCV Python With Source Code, please feel free to leave a comment below.

Technology stack and requirements

To run this Python project on your development machine, you need:

  • Python 3.10 or higher. Download from python.org or install via Anaconda if you prefer bundled packages.
  • pip package manager. Comes with Python. Used to install project dependencies from requirements.txt.
  • Virtual environment. Use venv or conda to isolate project dependencies from your global Python install.
  • VS Code or PyCharm. Free code editors with Python syntax highlighting, IntelliSense, and debugging.
  • Git. For version control and cloning source code repositories.

Installing the source code

  1. Download or clone the repository. Get the ZIP archive from the download link on this page and extract it.
  2. Create a virtual environment. Open a terminal in the project folder and run: python -m venv venv, then activate it (venv\Scripts\activate on Windows or source venv/bin/activate on Mac/Linux).
  3. Install dependencies. Run pip install -r requirements.txt to install all libraries the project needs.
  4. Configure environment variables. If the project uses API keys (OpenAI, Anthropic, database), create a .env file and set the required keys.
  5. Run the project. Follow the run command in the README (usually python main.py or streamlit run app.py).

Using this project for your BSIT capstone

  • Chapter 1 (Introduction). Discuss the real-world problem this system solves. Cite Philippine or international use cases where the manual process could be automated.
  • Chapter 2 (RRL). Compare your project against 5-10 similar published works. Cite ACM, IEEE, or arXiv papers for academic-standard sources.
  • Chapter 3 (Methodology). Document the model architecture, training data, hyperparameters, and evaluation metrics used.
  • Chapter 4 (Results). Report accuracy, precision, recall, F1-score, and confusion matrix. Screenshot the running app on real inputs.
  • Chapter 5 (Conclusion). Identify features for Version 2: better model, larger dataset, mobile deployment, or REST API.

Modules typical of Real-Time Face Landmark Detection using OpenCV

  • Image dataset preparation. Train/val/test split, augmentation (rotation, flip, brightness).
  • Model architecture. Pre-trained CNN (ResNet, EfficientNet) fine-tuned on your dataset.
  • Training loop. PyTorch or TensorFlow/Keras training with early stopping and checkpoints.
  • Evaluation. Confusion matrix, precision, recall, and per-class F1 scores.
  • Inference API. FastAPI endpoint accepting image uploads and returning predictions.
  • Web or mobile demo. Streamlit or React front-end for user interaction.

Common enhancements for capstone review

  • Grad-CAM visualization. Show which pixels the model focused on when making a prediction.
  • Data augmentation. Increase training data variety with imgaug or Albumentations library.
  • Transfer learning benchmark. Compare training-from-scratch vs fine-tuning pre-trained models.
  • Model quantization. Convert to TensorFlow Lite for mobile deployment.

Frequently Asked Questions

How does real-time face landmark detection work?

Uses dlib’s 68-point face landmark predictor (shape_predictor_68_face_landmarks.dat) or MediaPipe Face Mesh (468 landmarks). OpenCV captures the frame, the detector localizes the face, then the landmark predictor returns coordinates for eyes, eyebrows, nose, mouth, and jawline. Foundation for face-alignment, emotion recognition, eye-blink detection, and AR filters (Snapchat-style face overlays).

What Python and library versions do I need?

Python 3.10, 3.11, or 3.12 (avoid 3.13 until all DL wheels catch up). Install with: pip install opencv-python numpy. For deep learning models add: tensorflow keras (CPU build is fine for most demos), torch torchvision (PyTorch alternative), mediapipe (for face/hand/pose). Some projects also need: pytesseract for OCR, pyzbar for barcode, dlib for legacy face-landmark predictor.

Do I need a GPU to run this deep learning project?

For inference on a pretrained model: no, CPU runs at 10-30 FPS for most computer-vision tasks. For TRAINING a custom model: GPU strongly recommended (CPU works but slow). Free GPU options for training: Google Colab Free (12-hour sessions, sufficient for most BSIT capstones), Kaggle Notebooks Free. Buying a $1000+ GPU just for capstone is overkill.

Can I use this deep learning project for a BSIT or CSE capstone?

Yes, but extend it. A single OpenCV deep-learning demo (face detection, object detection alone) is too narrow for full capstone scope. Combine with a real domain wrapper: an attendance system using face recognition, a traffic monitoring system using vehicle detection, a wildlife camera using object detection, a driver-monitoring app using drowsiness detection. Add database logging, simple UI, and Chapter 1-5 manuscript.

Why does my model give wrong predictions or low accuracy?

Three most common causes: (1) Input preprocessing mismatch: the model expects 224×224 RGB normalized to [0,1] or [-1,1]; using BGR (OpenCV default) or wrong size produces garbage. (2) Insufficient training data: if you trained your own model on under 1,000 samples per class, accuracy plateaus low. Augment with cv2.flip, rotate, brightness shifts. (3) Lighting and angle drift between training and live use: train on data that matches the deployment environment.

Where can I find more deep learning project ideas with source code?

Browse our Deep Learning Projects hub for 19+ vision demos. For broader AI / ML / RAG / NLP capstones see 100+ AI Capstone Project Ideas. For pure ML (no deep learning) see Machine Learning Projects.

Angel Jude Suarez


Full-Stack Developer at PIES IT Solution

Focuses on Python development, machine learning, and AI integration. Has built production AI systems including OpenAI Whisper integration for medical transcription and GPT-4o-powered diagnosis assistance. Strong background in pandas, scikit-learn, and TensorFlow.

Expertise: Python · PHP · Java · VB.NET · ASP.NET · Machine Learning · AI Integration · OpenCV · Django · CodeIgniter
 · View all posts by Angel Jude Suarez →

Leave a Comment