Skip to content

An AI-driven system to monitor and enhance the engagement levels of the user. The system will analyze various engagement metrics, such as attention span, participation, and interaction.

Notifications You must be signed in to change notification settings

bhavna3/AI-Enhanced-Engagement-Tracker

Repository files navigation

README

Image Processing

Libraries/Frameworks Used:

  • OpenCV: 4.10.0.84

Developed Features:

  1. Image Blurring Reduces noise and smoothens details in an image by averaging pixel values within a specified radius, enhancing visual clarity in high-noise scenarios.

Input & Output

imageimage

  1. Contour Detection Identifies and highlights the boundaries of objects within an image, useful for shape analysis and object detection tasks.

    Input & Output

    imageimage

  2. Cropping Selects and isolates a specific region of interest from an image, allowing focus on a particular area without modifying the original image dimensions.

    Input & Output

imageimage

  1. Dilation and Erosion Morphological transformations that expand (dilation) or shrink (erosion) object boundaries in an image, enhancing or reducing specific features for analysis.

    Input

    image

    Output

image image

  1. Edge Detection Highlights the edges within an image, emphasizing significant transitions between colors or intensities, often used for feature extraction. Input & Output

    imageimage

  2. Histogram Equalization Adjusts the intensity distribution across an image to improve contrast, revealing finer details in images with poor lighting or low contrast. Input & Output

    imageimage

  3. HSV Conversion Converts an image from RGB to HSV (Hue, Saturation, Value) color space, separating color information for more flexible color analysis and filtering.

    Input & Output

    imageimage

  4. Image Stacking Combines multiple images in either horizontal or vertical layouts, useful for comparison and visualization of variations between images.

    Input

    imageimage

    Output

    imageimage

  5. Noise Addition Introduces random variations in pixel intensity, simulating real-world conditions for testing robustness in image processing algorithms.

    Input

image

Output

image

  1. Morphological Transformations Applies operations like opening, closing, or morphological gradients to enhance structures or filter out noise in binary images.

    Input

image

Output

image

  1. Resizing Alters the dimensions of an image, scaling it up or down while preserving its aspect ratio, important for consistent input size in model training.

    Input & Output

imageimage

  1. RGB to Grayscale Conversion Converts a colored image to grayscale by removing color information, simplifying analysis by reducing it to intensity variations.

    Input & Output

imageimage

  1. Rotation Rotates an image by a specified angle, useful for adjusting orientation or performing geometric transformations. Input & Output

imageimage

  1. Template Matching Searches for a specific pattern or template within an image, useful for object recognition and locating areas of interest.

    Input & Output

    imageimage


Video Processing

Libraries/Frameworks Used:

  • OpenCV: 4.10.0.84

Developed Features:

  1. Multi-video Processing

This function reads and displays images from a specified folder, printing the dimensions of each image.

image

image

  1. Video Stacking

This function reads and resizes two video files, concatenating them horizontally.

image

  1. Frame Rate Adjustment

This function captures video from the webcam, displays it in real-time, and calculates the FPS.

imageimage

  1. Video Saving

This function captures live video and saves it to a specified output file.

image](https://github.com/user-attachments/assets/dd50cd6b-bf80-4355-9c1b-48cdd0d95757)

  1. Video Streaming

This function captures live video from the webcam and displays it in real-time.

image](https://github.com/user-attachments/assets/222dd0c3-06c5-4319-9280-58fb1e01846b)


Annotations

Libraries/Frameworks Used:

  • OpenCV: 4.10.0.84
  • LabelImg: 1.8.6

Developed Features:

  1. Labeling

Used to draw bounding boxes on images based on annotations in the label files.

image

  1. Data Segregation

It organizes images and their label files into matched and unmatched directories.

image

  1. Label Manipulation

It updates class numbers in label files for object detection tasks.

image


Face Recognition

Libraries/Frameworks Used:

  • opencv-python: 4.10.0.84
  • face_recognition: 1.3.0
  • dlib: 19.24.6
  • pandas: 2.0.2
  • numpy: 1.23.3
  • datetime: 5.5
  • imutils: 0.5.4
  • os (standard library)

Developed Features:

  1. Face Recognition

Face detection using the face_recognition library.

image](https://github.com/user-attachments/assets/a5f8ac69-c191-4ebd-9854-f20cc6b5d8bc)![image](https://github.com/user-attachments/assets/5424afa0-aeab-4196-a40a-879781328f5b)

  1. Attendance Save

When the face is recognized, the event is logged with the date and time in an Excel file.

image](https://github.com/user-attachments/assets/a5f8ac69-c191-4ebd-9854-f20cc6b5d8bc)![image](https://github.com/user-attachments/assets/a3043b08-9b67-40f8-8bbe-e4cd27032ede)

  1. Facial Landmarks

Uses dlib's landmark predictor to monitor attentiveness based on head pose, logging scores and saving annotated screenshots, the event is logged in an Excel file.

image](https://github.com/user-attachments/assets/aad7ac9a-66f0-47ab-ad38-5680cf5a25f3)![image](https://github.com/user-attachments/assets/92cd9d54-a05b-4758-85db-b11d242088be)

  1. Attention Score

Calculates attention scores using face recognition and screenshots are saved for analysis.

image](https://github.com/user-attachments/assets/1e095512-6861-40de-800e-738aabfd6209)![image](https://github.com/user-attachments/assets/0a670cc0-f8d9-4986-86fe-961c148c1036)

  1. Average Attention Score

Calculates average attention scores using face recognition and screenshots are saved for analysis.

image](https://github.com/user-attachments/assets/1e095512-6861-40de-800e-738aabfd6209)![image](https://github.com/user-attachments/assets/a40b3e02-f501-428d-bc6b-9ee6aee2fd06)

  1. Excel_sc_dt

Captures video, logs attendance, and saves screenshots and tracks attention.

image](https://github.com/user-attachments/assets/a5f8ac69-c191-4ebd-9854-f20cc6b5d8bc)![image](https://github.com/user-attachments/assets/7e611658-9421-4e11-93ce-27d862d25fad)

  1. excel_sc

An alternative configuration for logging and capturing screenshots.

image](https://github.com/user-attachments/assets/a5f8ac69-c191-4ebd-9854-f20cc6b5d8bc)![image](https://github.com/user-attachments/assets/58282cb3-07d6-41cc-9fa3-e393f7fbd66f)

  1. Tools

Additional tools and utilities for face recognition, the events are logged in an Excel file.

image](https://github.com/user-attachments/assets/a5f8ac69-c191-4ebd-9854-f20cc6b5d8bc)![image](https://github.com/user-attachments/assets/eb4ecba8-8d1b-430f-a31d-9ee566a919eb)

  1. Test

Testing helper functions and utilities for face recognition, the events are logged in an Excel file.

image](https://github.com/user-attachments/assets/a5f8ac69-c191-4ebd-9854-f20cc6b5d8bc)![image](https://github.com/user-attachments/assets/6317f1c7-70b0-435b-bc7b-385c275f7c60)


Additional Features

Detect Emotions

This code implements a facial emotion detection system using DeepFace and OpenCV libraries. It takes an image input, detects faces using OpenCV, and analyzes emotions (like happy, sad, angry, etc.) using the DeepFace framework. The program draws bounding boxes around detected faces and displays the dominant emotion with its probability. Results are visualized using matplotlib, showing both the original and annotated images side by side, along with a breakdown of emotion probabilities. The code is structured with separate functions for image loading, result visualization, and main processing, making it modular and easy to maintain.

  1. Anger Detection

image

  1. Happiness Detection

image

  1. Suprise Detection

image

About

An AI-driven system to monitor and enhance the engagement levels of the user. The system will analyze various engagement metrics, such as attention span, participation, and interaction.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages