tasks/classify/

[giscus[bot]]

tasks/classify/

Learn about YOLOv8 Classify models for image classification. Get detailed information on List of Pretrained Models & how to Train, Validate, Predict & Export models.

https://docs.ultralytics.com/tasks/classify/

[William-Yao0993]

I have a pretrained model that can do detection and segmentation with my custom dataset, Can the model continue be trained for classification purpose, and predicts by passing the task argurment? Or its better to train and save a new model for classify purpose?

[William-Yao0993]

That is a really good answer. Thanks for your help.

[pderrenger]

@William-Yao0993 you're welcome! If you have any more questions or need further assistance as you work on your project, feel free to reach out. Good luck with your training and predictions! 😊🚀

[sh3mmy]

@pderrenger i'm trying to do something similar, i've trained a classification network and now i would like to retrain the network to do both classify and detection. how would i go about this? do i need a different data set?

im using colab so i attempted to retrain it like this:

!yolo task=detect mode=train model=/content/drive/MyDrive/runs/classify/train7/weights/best.pt data = {DATA}

but i got this error:

WARNING ⚠️ conflicting 'task=detect' passed with 'task=classify' model. Ignoring 'task=detect' and updating to 'task=classify' to match model.

[pderrenger]

It seems like you're trying to retrain a classification model to also perform detection. To achieve this, you'll need a dataset that includes both class labels and bounding box annotations. The error you encountered indicates that there's a conflict between the task specified in the command (task=detect) and the task inferred from the model (task=classify).

To resolve this, you should ensure that your model is compatible with detection tasks. This typically requires a model architecture that supports both classification and detection, and a dataset prepared with the necessary annotations for detection.

If you're using a model trained only for classification (like yolov8n-cls.pt), it won't be directly applicable for detection tasks without modification. You might need to train a new model with a suitable architecture (like yolov8n.pt) on a dataset that includes the required detection annotations.

For more guidance, please refer to the Ultralytics documentation on training models for detection tasks.

[rromanchuk]

@William-Yao0993 for a pretrained model that is already capable of detection and segmentation on your custom dataset, you can indeed continue training it for classification purposes. This is feasible because YOLOv8 supports multi-task learning, allowing a single model to perform various computer vision tasks, including classification.

Can you demonstrate this by providing two command line examples using the same model, but with varying tasks?

Can you also provide the reference documentation link to multi-task learning?

[William-Yao0993]

@pderrenger i'm trying to do something similar, i've trained a classification network and now i would like to retrain the network to do both classify and detection. how would i go about this? do i need a different data set?

im using colab so i attempted to retrain it like this:

!yolo task=detect mode=train model=/content/drive/MyDrive/runs/classify/train7/weights/best.pt data = {DATA}

but i got this error:

WARNING ⚠️ conflicting 'task=detect' passed with 'task=classify' model. Ignoring 'task=detect' and updating to 'task=classify' to match model.

I think you need to modify the dataset structure to be compatible with Detection as @pderrenger stated and might need to use .load() to transfer weights from YOLO pretrained or customed model for detection, because from my experience, I transferred weights from 'yolov8-seg' when transfer detection to segmentation model, it should be similar to classify. Please Correct me if I am wrong.

[glenn-jocher]

Yes that's correct, you can use mode.load() to transfer weights from another checkpoint. Weights can transfer across tasks as well to a certain extent, i.e. you can transfer many detection model weights to a pose model for example.

from ultralytics import YOLO

# Create a new detection model and transfer the weights from a classification model
detect_model = YOLO('yolov8n.yaml').load('path/to/classification/model.pt')

# Now you can train for detection
detect_model.train(data='path/to/data.yaml', epochs=3)

[Leprah]

how if i want to retrain my model with the same task (classify). it the same command using .load()?
fyi i want to do replay training with multiple dataset and my previous model classify

[glenn-jocher]

To retrain your classification model with multiple datasets, you can use the .load() method to load your existing model and continue training. Ensure your datasets are structured correctly for classification. Here's a simple example:

from ultralytics import YOLO

# Load your existing model
model = YOLO('path/to/your/model.pt')

# Retrain with a new dataset
model.train(data='path/to/new/dataset', epochs=50)

Make sure your datasets are compatible with the classification task format.

[Vinrub]

i want solo object detection code for video then want to merge my object half identification code status = False
img1_yCrCb_r = cv2.cvtColor(right_light_img1, cv2.COLOR_BGR2YCrCb)
img1_yCrCb_l = cv2.cvtColor(left_light_img1, cv2.COLOR_BGR2YCrCb)

img2_yCrCb_r = cv2.cvtColor(right_light_img2, cv2.COLOR_BGR2YCrCb)
img2_yCrCb_l = cv2.cvtColor(left_light_img2, cv2.COLOR_BGR2YCrCb)

img1_Y_r,img1_Cr_r,img1_Cb_r = cv2.split(img1_yCrCb_r)
img1_Y_l, img1_Cr_l, img1_Cb_l = cv2.split(img1_yCrCb_l)

img2_Y_r,img2_Cr_r,img2_Cb_r = cv2.split(img2_yCrCb_r)
img2_Y_l, img2_Cr_l, img2_Cb_l = cv2.split(img2_yCrCb_l)


ret, thresh1_r = cv2.threshold(img1_Cr_r, 200, 255, cv2.THRESH_BINARY)
cv2.imshow("thresh1_r",thresh1_r)
cv2.waitKey(0)
ret, thresh1_l = cv2.threshold(img1_Cr_l, 200, 255, cv2.THRESH_BINARY)

ret2, thresh2_r = cv2.threshold(img2_Cr_r, 200, 255, cv2.THRESH_BINARY)
ret, thresh2_l = cv2.threshold(img2_Cr_l, 200, 255, cv2.THRESH_BINARY)
cv2.imshow("thresh1_r",thresh1_r)
cv2.waitKey(0)
non1_r = cv2.countNonZero(thresh1_r)
non1_l = cv2.countNonZero(thresh1_l)

non2_r = cv2.countNonZero(thresh2_r)
non2_l = cv2.countNonZero(thresh2_l)

non1 = non1_r+non1_l
non2 = non2_r + non2_l

difference = abs(non1 - non2)

print(difference)

[glenn-jocher]

@Vinrub hey there! 👋 It looks like you're interested in performing object detection on video frames and then integrating some custom processing based on the detection results. Here's a simplified approach to get you started with object detection using a YOLOv8 model. After detection, you can incorporate your specific processing logic.

First, ensure you have the ultralytics package installed:

pip install ultralytics

Here's a basic example to run object detection on a video stream using YOLOv8:

from ultralytics import YOLO
import cv2

# Load the YOLO model
model = YOLO('yolov8n.pt')  # Adjust model as needed

# Open your video
cap = cv2.VideoCapture('path/to/your/video.mp4')

while cap.isOpened():
    ret, frame = cap.read()
    if not ret:
        break

    # Run detection
    results = model(frame)

    # Extract detected objects (for example, filtering by confidence and class)
    for *box, conf, cls in results.pred[0]:
        if conf > 0.5:  # Example confidence threshold
            # Your custom processing here
            pass

    # Example: Show the frame with detections
    cv2.imshow('Frame', np.squeeze(results.render()))
    if cv2.waitKey(1) & 0xFF == ord('q'):
        break

cap.release()
cv2.destroyAllWindows()

For the second part of your question, regarding merging object identification code, it seems you're processing color channels and applying thresholds. You can integrate this logic after the detection step, using the detected object's bounding box coordinates to isolate regions of interest in your frames for further processing.

Remember, the key is to adapt the detection loop to your specific needs, whether it's processing certain object classes differently or applying custom logic based on detection results. If you have more detailed requirements or need further assistance, feel free to ask! 🚀

[mansoormirza]

I trained a yolov8-l classification model where I was perform classification on some images, few months back it was working perfectly fine, was classifying accurately, but few days ago, when I ran the model again on an image I got an error, something like this

This is the code, where I am loading a trained model .pt file

from ultralytics import YOLO
import numpy as np

model = YOLO('/content/drive/MyDrive/best.pt')
results = model('/content/image.jpg')

And Getting error like this:

AttributeError Traceback (most recent call last)
in <cell line: 6>()
4 model = YOLO('/content/drive/MyDrive/best.pt')
5
----> 6 results = model('/content/image.jpg')
7
8

9 frames
/usr/local/lib/python3.10/dist-packages/PIL/Image.py in getattr(self, name)
527 deprecate("Image categories", 10, "is_animated", plural=True)
528 return self._category
--> 529 raise AttributeError(name)
530
531 @Property

AttributeError: shape

Cant figure out this error, Kindly If anyone could help with this.

[pderrenger]

Hello! It looks like you're encountering an AttributeError: shape when trying to run predictions with a YOLOv8 classification model. This type of error is often related to how the data is processed or accessed, but without the complete error message, it's a bit challenging to pinpoint the exact issue.

That said, the code snippet you've provided for loading and running the model seems correct. Make sure the image path is correct and accessible. Also, ensure there haven't been updates to the Ultralytics YOLO package that might require changes in how models are loaded or executed. A good first step is to check if your Ultralytics YOLO version is up to date:

pip install ultralytics --upgrade

Additionally, make sure your .pt model file hasn't been corrupted or altered. If possible, try re-downloading or re-training the model to ensure its integrity.

If you're still facing the issue, could you share a bit more detail about the complete error stack or any changes made to the environment or code since it last worked? That could give us better clues towards a solution. 🕵️‍♂️

Let us know how it goes, and we'll be here to assist further!

[skfirebox]

i have 73 bad images and 4000 good images, can yolov8 work for this or not (For classification problem), if yes , then what i will do ?
also tell me how i run yolov8 in my system for classification problem on Custom Dataset?

[glenn-jocher]

@skfirebox hello! Absolutely, YOLOv8 can work on your classification problem with a dataset comprising 73 bad images and 4000 good images. Given the imbalance, you may consider using techniques like oversampling for the minority class or applying class weights during training for better performance. 📊

For setting up YOLOv8 for classification on your custom dataset, you'll be using a YOLOv8 Classify model, like the yolov8n-cls.pt which is pretrained on ImageNet. Here's a quick guide:

1. Ensure your dataset is prepared according to the YOLO classification dataset format.
2. Install the Ultralytics YOLO package if you haven't already:

   pip install ultralytics

3. Load and train your model:

   from ultralytics import YOLO
   
   # Load a pretrained classification model
   model = YOLO('yolov8n-cls.pt')
   
   # Train the model on your dataset
   model.train(data='path/to/your_dataset.yaml', epochs=100, imgsz=224)

   Replace 'path/to/your_dataset.yaml' with the path to your dataset configuration file.

Or via CLI:

yolo classify train data=path/to/your_dataset.yaml model=yolov8n-cls.pt epochs=100 imgsz=224

Remember to customize epochs, imgsz, or any other relevant parameters as needed to suit your dataset better.

For further details on classification with Ultralytics YOLO, including how to validate, predict, and export your models, refer to the YOLOv8 classification documentation.

All the best with your classification project! If you have more questions, feel free to ask. 🚀

[supj8]

What are the main differences in the model architecture of Classify and Detect?

[pderrenger]

@supj8 hey there! 😊 Great question about the differences in model architecture between Classify and Detect tasks in YOLOv8.

The main difference lies in their objectives and output:

• Classify (YOLOv8-cls models): Focuses on classifying the entire image into one of the predefined classes. It's simpler since the output is a single class label and a confidence score. It's excellent when you only need to know the category of the whole image without the specifics of object locations. These models are pretrained on the ImageNet dataset, reflecting their focus on broad image classification.

• Detect (YOLOv8 models without the -cls suffix): Aims at detecting objects within an image, drawing bounding boxes around them, and classifying each detected object. It's more complex because the output includes locations (bounding boxes), class labels, and confidence scores for multiple objects within the same image. These models are typically pretrained on the COCO dataset, which is rich in object localization and classification data.

In essence, Classify models are about "what is in this picture?" while Detect models answer "what and where are the objects in this picture?"

Here's a little Python snippet to illustrate loading a classification model:

from ultralytics import YOLO

model = YOLO('yolov8n-cls.pt')  # Load a pretrained classification model

And for detection:

from ultralytics import YOLO

model = YOLO('yolov8n.pt')  # Load a pretrained detection model

Hope this helps clarify things! Let me know if you have any more questions. 🌟

[supj8]

Thanks for the response! Specifically though, are you able to tell me the difference at a fundamental level? For example, I have seen in the .yaml files than Classify does not have the SPPF module in the backbone. What are the other differences in the neck and head? Or is there somewhere I can read about this instead of inspecting the source code? Thanks!

[pderrenger]

@supj8 hey there! 😄 Absolutely, I can shed some light on that. Beyond the SPPF module difference in the backbone for Classify compared to Detect models, there are other architectural variations primarily focused around the model's objective - classification vs. object detection.

Classify models (e.g., YOLOv8-cls), designed purely for image classification, have a more streamlined structure since their main job is to assign a label to the entire image. This often means a simpler "head" architecture, as there's no need for the additional complexity required to predict bounding boxes or object masks.

On the other hand, Detect models include additional layers and structures in the "neck" and "head" to handle the localization (where the objects are) and classification of multiple objects within an image. This can include various feature pyramid networks (FPN) or panoptic feature pyramid networks (PFPN) in the neck to merge feature maps from different layers, and more complex head structures for bounding box regression, object classification, and sometimes even segmentation.

For a deep dive without delving into source code, the Ultralytics YOLO Documentation is a fantastic place to start! Check out the sections on Image Classification for insights on Classify models and Object Detection for Detect models. These pages provide an overview of what each model type is tailored for, including some hints on their internal workings.

Hope this helps clear things up a bit! If you've got more questions, feel free to toss them my way! 🚀

[eladoni1]

Hi there!
Quick briefing - the images are of size Width = 1216, Height = 292.

TL;DR - After debug into train.py & predict.py, realized the images are resized + cropped strangely from what I gathered in the docs/forums, even with specified imgsz and rect=True.

Full explanation -

Training was :
model.train(data=..., imgsz=1216, rect=True)

Expectations :
Was expecting the dataset images to be resized BY THE LARGER side, so 1216 will remain 1216, and so is the smaller side.

(Even when I tried to do imgsz as a tuple - (h,w) aka (292,1216), a warning showed up, telling me the imgsz will be automatically selected to 1216, as it should have been an integer.. not a tuple.)

What actually happened :
What happened is the smaller side (height, 292) resized to 1216, then the original, bigger side (width, 1216), was resized to 5063 (same scalar the smaller side was multiplied).

Meaning, what previously was image of size 1216x292, turned into image of size 5063x1216 (This is due to Resize transformation of pytorch)

And its not over - the data taken was only the INNER 1216x1216 - less than 1/4 of the actual data.. (This is due to CenterCrop transformation of pytorch)

So, basically, I am asking - Is there a quote from the docs I have missed that said classify must be square sized? Or is there another way (except from padding to 1216x1216 - adding 924 black pixels to the height), to make classify work with rectangular images?

Thank you so much, and sorry if I wasnt clear.. hopefully it was.

[glenn-jocher]

Hey there! 🙌 Thanks for the detailed message.

It seems like you've encountered an interesting scenario with image sizes and the rect=True parameter. In YOLOv8, when using rectangular training (rect=True), the model does expect square input sizes for simplicity and efficiency. The behavior you've noticed, where the smaller dimension gets resized to match the specified imgsz, and then the image is center-cropped, is by design for handling non-square inputs.

For your specific case with rectangular images (1216x292), instead of resizing or padding the images manually to make them square, a recommended approach is to work with the default behavior but ensure your imgsz is set to the dimension that avoids data loss. If further customization is necessary, it might involve custom modifications to the data preprocessing pipeline.

Unfortunately, there isn't a built-in switch for direct handling of non-square images without cropping or resizing as you described. This is an area for potential improvement in future updates!

For now, perhaps consider either adjusting your pipeline to accommodate this behavior or implementing a custom preprocessing step that ensures your images maintain their aspect ratio without significant data loss. Padding might be an unavoidable step for cases like these.

If there's anything else we can help with or if you have suggestions, feel free to reach out. Thanks for diving deep into this, and we're here to support your projects! 🚀

[Hzw12138]

Hi, I have identified a small issue in the example provided for training in the classification task, which is 'results = model.train(data='mnist160', epochs=100, imgsz=64)'. The parameter 'imgsz' should actually be 640.

[glenn-jocher]

@Hzw12138 hey there! 😊 Thanks for pointing out the discrepancy in the image size parameter. The imgsz value in the training example indeed serves as a placeholder, meant to be adjusted according to specific model requirements and dataset characteristics. For typical classification tasks using models like yolov8n-cls, the input size is often set to lower dimensions tailored to the task, differing from object detection model sizes like 640. If training on MNIST160, which has smaller images, an imgsz of 64 or similarly scaled dimensions might be appropriate depending on the dataset specifics.

For larger or different image datasets, adjusting imgsz to match your model and data requirements would be the way to go. For instance, using:

results = model.train(data='your_dataset', epochs=100, imgsz=224) 

or even 640, if that's what works best for you. Hope this clears things up! Let us know if there's anything else we can help with. Happy training!

[nepulepu]

When I try to train my custom data, it raised Runtime Error

    raise RuntimeError(emojis(f"Dataset '{clean_url(self.args.data)}' error ❌ {e}")) from e
RuntimeError: Dataset 'path/to/dataset/data.yaml' error  [WinError 3] The system cannot find the path specified: 'path\\to\\dataset\\data.yaml\\train'

while in my yaml file is

train: ../train/images
val: ../valid/images
test: ../test/images

nc: 4
names: ['a', 'b', 'c', 'd']

why it did not go into train folder?

[glenn-jocher]

Hi there! It looks like the system cannot find the specified path based on the error you've encountered. This often happens when there's a discrepancy between the paths defined in your dataset's YAML file and the actual file paths on your system.

Based on your data.yaml, your dataset structure should be something like:

- Your_project_folder/
  - train/
    - images/
  - valid/
    - images/
  - test/
    - images/
  data.yaml

And your data.yaml should look like this if the data.yaml is located in Your_project_folder:

train: ./train/images
val: ./valid/images
test: ./test/images

nc: 4
names: ['a', 'b', 'c', 'd']

Please ensure that:

1. The paths to your train, val, and test folders are correct relative to the location of your data.yaml file.
2. All specified directories exist in your filesystem.

If your YAML file is correctly set and you're still facing issues, it might be helpful to use absolute paths in the YAML file to troubleshoot the problem. Also, ensure that there are no typos in the path.

Hope this helps! Let us know if you have further issues. 😊

[nepulepu]

Hello,
Thanks for your response.
It works when I use the object detection model but if I use suffix '-cls' model it has error at

venv-path\lib\site-packages\ultralytics\engine\trainer.py

where the get_dataset function like this:

    def get_dataset(self):
        """
        Get train, val path from data dict if it exists.

        Returns None if data format is not recognized.
        """
        try:
            if self.args.task == "classify":
                data = check_cls_dataset(self.args.data)
            elif self.args.data.split(".")[-1] in {"yaml", "yml"} or self.args.task in {
                "detect",
                "segment",
                "pose",
                "obb",
            }:
                data = check_det_dataset(self.args.data)
                if "yaml_file" in data:
                    self.args.data = data["yaml_file"]  # for validating 'yolo train data=url.zip' usage
        except Exception as e:
            raise RuntimeError(emojis(f"Dataset '{clean_url(self.args.data)}' error ❌ {e}")) from e
        self.data = data
        return data["train"], data.get("val") or data.get("test")

is the dataset has different format and if it has, what format should i export at roboflow?
Thanks

[glenn-jocher]

@nepulepu hey there! 👋 It looks like you're facing an issue with dataset paths when using a classification model (-cls). The error message indicates a problem with finding the specified dataset path in your YAML file.

For classification tasks with YOLOv8, the dataset structure is a bit different from detection tasks. Make sure your dataset is prepared according to the YOLO classification dataset format guide.

If you're exporting your dataset from Roboflow for classification, you should export it as Classification (Folders) format, which organizes images into subfolders named after their classes.

Your data.yaml should look like this for classification tasks:

train: path/to/train/directory  # Directory containing class-named subdirectories with images
val: path/to/val/directory      # Same as above for validation data

nc: 4                           # Number of classes
names: ['a', 'b', 'c', 'd']     # Class names

Ensure the train and val paths are accurate and point to the directories containing your class-named subdirectories. 📁

Feel free to reach out again if you face any more issues!

[okurx]

Hello, ı hope your day is going well.
I am trying to make a race detection model with yolov8x classification. I have custom dataset and 6 class i have 5377 images for each train class folder and i have 654 images for each test class folder.

• /content/data/

  • train/
    • asian/
      -images/
    • latino/
      -images/
    • white/
      -images/
      .....

• /content/data/

  • test/
    • asian/
      -images/
    • latino/
      -images/
    • white/
      -images/
      .....

I run this code and ı get max 0.764 acc. I want to improve my acc value. I changed optimizer but it did not improve. What should ı do. Please help me :((
import os
from ultralytics import YOLO

Load a model

model = YOLO("yolov8x-cls.pt") # load a pretrained model

Train the model and save the results

results = model.train(data='/content/data', epochs=200, imgsz=224, scale=0)

[pderrenger]

Hello! Your project sounds exciting, and it's great to see you using YOLOv8x for race detection. Achieving a max accuracy of 0.764 is a good start, but I understand wanting to push that further. Here are a couple of recommendations that might help improve your model's accuracy:

1. Data Augmentation: Consider applying more robust data augmentation techniques. This could include varying lighting conditions, rotations, and flips. It can help make your model more robust to changes in input.

2. Learning Rate Schedule: Experimenting with different learning rate schedules might be beneficial. Sometimes, a dynamic learning rate (e.g., using ReduceLROnPlateau) could help in converging to a better minimum.

3. Model Complexity: You are using yolov8x-cls.pt, which is quite powerful. If your dataset is highly specialized, consider modifying the architecture to better suit your dataset's specificity. This might involve changing the model's depth or width for optimal performance.

4. Hyperparameters Tuning: Beyond the optimizer, tuning hyperparameters (like weight_decay, momentum, etc.) can have a substantial effect. Consider using automated tools like WandB or HyperOpt for systematic experimentation.

5. Regularization and Dropout: Ensuring you’re not overfitting with regularization techniques and potentially employing dropout in your network might help in achieving better generalization.

Remember, improving a model can sometimes be a matter of trial and error, so patience is key. Here’s a quick example of introducing a learning rate scheduler with your current setup:

from ultralytics import YOLO

# Load the model
model = YOLO("yolov8x-cls.pt")

# Define a scheduler (example)
scheduler = {'lr0': 0.01, 'lrf': 0.1, 'momentum': 0.937, 'weight_decay': 0.0005}

# Train the model with scheduler
results = model.train(data='/content/data', epochs=200, imgsz=224, scheduler=scheduler)

Please keep in mind that adjusting the learning rate scheduler directly in the train method like the example above is a simplified illustration. You might need to dive deeper into the training configuration or the codebase to effectively integrate more complex scheduling strategies.

Hope this helps! Keep experimenting, and I’m sure you’ll see improvements soon. 😊

[sourestdeeds]

How would i write a custom loss function to be used only during training, and the default loss for validation?

I tried this in tasks.py

def init_criterion(self):
        """Initialize the loss criterion for the ClassificationModel."""
        return v8ClassificationCustomLoss(self) if self.training else v8ClassificationLoss()

[pderrenger]

Hey there! 👋

It looks like you're on the right track with customizing the loss function based on the training or validation phase. Your approach in tasks.py is generally correct for switching between different loss functions during training and validation.

However, make sure that the self.training attribute is correctly toggled between True and False during the training and validation phases. This attribute should be managed by the training script, typically set by calling model.train() for training and model.eval() for validation.

Here's a quick example to ensure it's set correctly:

if self.training:
    print("Training mode: Using custom loss")
else:
    print("Validation mode: Using default loss")

Add this print statement inside your init_criterion method to debug and confirm that the switch is happening as expected.

If you continue to face issues, ensure that your custom loss functions (v8ClassificationCustomLoss and v8ClassificationLoss) are implemented correctly and are compatible with your model's output.

Happy coding! 😊

[mr-lz]

Hello, can a pretrained detection model be modified and applied to a classification task?

[pderrenger]

Hello! Yes, you can adapt a pretrained detection model like YOLOv8 for a classification task, but it involves modifying the model architecture to handle classification-specific outputs. For straightforward classification tasks, I recommend using a dedicated classification model like yolov8n-cls.pt, pretrained on ImageNet for better performance.

Here's how you can load and use a dedicated classification model:

from ultralytics import YOLO

# Load a pretrained classification model
model = YOLO('yolov8n-cls.pt')

# Predict on an image
results = model('path/to/image.jpg')
print(results)

This approach ensures that the model is optimized for accurate image classification right out of the box. Let me know if there's anything else you need! 😊

[dalmeidalorraine]

Rewrite: I have an image classification use case where the images could belong to class 1 or class 2, both class 1 and class 2 and neither. What's the best way to setup this classification using ultralytics image classifiers? Currently I have 4 folders class 1, class2, both, neither. Can you provide suggestions?

[dalmeidalorraine]

I have an image classification use case where images could belong to class 1, class 2, both class 1 and class 2, or neither. What's the best way to set up this classification using Ultralytics image classifiers? Currently, I have four folders: class 1, class 2, both, and neither. Should I stick with this setup, or would it be better to have just three folders: class 1, class 2, and neither? Any suggestions?

[pderrenger]

@dalmeidalorraine your setup with four folders (class 1, class 2, both, neither) is almost spot-on for handling the multi-label classification scenario you've described. However, it's crucial to approach this as a multi-label (not multi-class) task because each image might belong to multiple categories.

For handling such scenarios using Ultralytics image classifiers, you would typically define your dataset similarly to how you've organized it but ensure that each image can have multiple labels. Here's a small example to structure your data labels correctly:

1. Prepare your dataset: This could be a CSV file or similar, where each image path is listed along with its corresponding labels like so:

   path/to/image.jpg, class1, class2
   path/to/another/image.jpg, neither
   

   This can also be set up in a JSON or YAML format depending on what the model expects.

2. Set up your classification: When you load your model and dataset, make sure the model understands this is a multi-label classification task. This might involve some adjustments in your model configuration if your scenario is not typically a binary classification for each label.

3. Training the model: Use a suitable loss function that can handle multi-label scenarios, such as Binary Cross-Entropy, which is commonly used for multi-label classification tasks.

Here’s an example of how you might configure your dataset:

from ultralytics import YOLO
# Load the model
model = YOLO('yolov8n-cls.yaml')

# Setup for multi-label (dummy dataset paths)
data = {
  'train': '/path/to/train_images',
  'val': '/path/to/val_images',
  'nc': 4,  # number of classes
  'names': ['class1', 'class2', 'both', 'neither']
}

# Set up your training
results = model.train(data=data, epochs=100, imgsz=640)

The above code is an initial pointer; adjust the paths and parameters as needed for your setup. Make sure all labels for each image are properly marked in your dataset files. This will help the model learn to predict multiple classes simultaneously from your images. Keep the four categories as they represent separate labels clearly, distinguishing between individual and combined classes!

[dalmeidalorraine]

Hi, thanks for your response. Step 1 is not entirely clear to me. Could you please clarify how I can pass that as an input to the ultralytics classification model?

[pderrenger]

Hello! I'm glad to help clarify how you can input your data for image classification using Ultralytics models. 🌟

For image classification tasks, you typically need to prepare your dataset in a format that the model can process. This usually involves organizing your images into a structured directory or listing them in a file with their corresponding labels.

Here’s a quick example of how you might set up your data for a classification model:

1. Organize your images: Place your images in folders named after their respective classes. For example:

   /dataset
     /class1
       - img1.jpg
       - img2.jpg
     /class2
       - img3.jpg
       - img4.jpg
   

2. Prepare a dataset file: Create a .yaml file that specifies the paths to your training and validation datasets, along with class names. For example:

   path: /path/to/dataset  # dataset root dir
   train: train/images  # relative to 'path', train images
   val: val/images  # relative to 'path', validation images
   nc: 2  # number of classes
   names: ['class1', 'class2']  # class names

3. Load and train your model:

   from ultralytics import YOLO
   
   # Load a model
   model = YOLO("yolov8n-cls.pt")  # load a pretrained model
   
   # Train the model
   results = model.train(data="path/to/your/dataset.yaml")

This setup should help you get started with training your classification model on your dataset. If you need further assistance or have more specific requirements, feel free to ask! 😊

[rromanchuk]

Hi, thanks for your response. Step 1 is not entirely clear to me. Could you please clarify how I can pass that as an input to the ultralytics classification model?

@dalmeidalorraine this is just a LLM responding to you. It's correctly describing what a multi label classification task usually looks like, and the different loss function required, but this is not supported by ultralytics frameworks.

[wenching33]

Hi,
What is the preprocessing parameter of the default training process ?
I mean after resizing to (640,640), do you do (x/255 - mean)/std ?, what will be the mean, std value?

[glenn-jocher]

Hello!

For the default training process, the preprocessing steps after resizing the image to (640,640) include normalization. The images are normalized using the formula (x / 255 - mean) / std. The mean and std values used are typically:

• mean: [0.485, 0.456, 0.406]
• std: [0.229, 0.224, 0.225]

These values are standard for models pre-trained on the ImageNet dataset. This normalization helps in stabilizing the learning process and leads to faster convergence.

If you need to adjust these for your specific dataset, you can modify them in the dataset configuration or during the data loading phase. Happy coding! 😊

[wenching33]

Hi~
mean: [0.485, 0.456, 0.406]
std: [0.229, 0.224, 0.225]
Are these in RGB order ? or BGR order ?
Thanks

[glenn-jocher]

Hi there! 👋

Yes, the mean and std values you mentioned ([0.485, 0.456, 0.406] for mean and [0.229, 0.224, 0.225] for std) are indeed in RGB order. This is the standard order used for models that are pretrained on the ImageNet dataset.

If you have any more questions or need further clarification, feel free to ask. Happy coding! 😊

[kk26nav]

I wanted to train a classification model on my custom datset. When i run the code i get this error

Traceback (most recent call last):
File "", line 1, in
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\spawn.py", line 122, in spawn_main
exitcode = _main(fd, parent_sentinel)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\spawn.py", line 131, in _main
prepare(preparation_data)
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\spawn.py", line 246, in prepare
_fixup_main_from_path(data['init_main_from_path'])
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\spawn.py", line 297, in _fixup_main_from_path
main_content = runpy.run_path(main_path,
^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 291, in run_path
File "", line 98, in _run_module_code
File "", line 88, in _run_code
File "c:\Users\snk20\Downloads\Brain Tumor\braintunor.py", line 5, in
results = model.train(data="C:/Users/snk20/Downloads/Brain Tumor/MRI", epochs=100, imgsz=512)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\engine\model.py", line 674, in train
self.trainer.train()
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\engine\trainer.py", line 199, in train
self._do_train(world_size)
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\engine\trainer.py", line 318, in _do_train
self._setup_train(world_size)
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\engine\trainer.py", line 282, in _setup_train
self.train_loader = self.get_dataloader(self.trainset, batch_size=batch_size, rank=RANK, mode="train")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\models\yolo\classify\train.py", line 91, in get_dataloader
loader = build_dataloader(dataset, batch_size, self.args.workers, rank=rank)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\data\build.py", line 135, in build_dataloader
return InfiniteDataLoader(
^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\ultralytics\data\build.py", line 39, in init
self.iterator = super().iter()
^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\torch\utils\data\dataloader.py", line 439, in iter
return self._get_iterator()
^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\torch\utils\data\dataloader.py", line 387, in _get_iterator
return _MultiProcessingDataLoaderIter(self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\site-packages\torch\utils\data\dataloader.py", line 1040, in init
w.start()
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\process.py", line 121, in start
self._popen = self._Popen(self)
^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\context.py", line 224, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\context.py", line 336, in _Popen
return Popen(process_obj)
^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\popen_spawn_win32.py", line 46, in init
prep_data = spawn.get_preparation_data(process_obj._name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\spawn.py", line 164, in get_preparation_data
_check_not_importing_main()
File "C:\Users\snk20\anaconda3\Lib\multiprocessing\spawn.py", line 140, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.

    This probably means that you are not using fork to start your
    child processes and you have forgotten to use the proper idiom
    in the main module:

        if __name__ == '__main__':
            freeze_support()
            ...

    The "freeze_support()" line can be omitted if the program
    is not going to be frozen to produce an executable.

    To fix this issue, refer to the "Safe importing of main module"
    section in https://docs.python.org/3/library/multiprocessing.html

Could you please tell what mistake im making here?

[glenn-jocher]

Hi there! 😊

Thank you for reaching out and providing detailed information about the issue you're encountering. It looks like you're trying to train a classification model on your custom dataset but running into a multiprocessing error.

To help you better, could you please provide a minimum reproducible example of your code? This will allow us to replicate the issue on our end and investigate it more effectively. You can find guidelines on how to create a minimum reproducible example here.

Additionally, please ensure that you are using the latest versions of torch and ultralytics. You can update your packages using the following commands:

pip install --upgrade torch
pip install --upgrade ultralytics

The error you're seeing is related to the multiprocessing module in Python, which often occurs when the script is not protected by the if __name__ == "__main__": guard. This is necessary to prevent the multiprocessing module from running the script multiple times. Here’s a quick example of how you can structure your script:

from ultralytics import YOLO

if __name__ == "__main__":
    # Load a model
    model = YOLO("yolov8n-cls.pt")  # load a pretrained model (recommended for training)

    # Train the model
    results = model.train(data="C:/Users/snk20/Downloads/Brain Tumor/MRI", epochs=100, imgsz=512)

This should help resolve the multiprocessing issue. If the problem persists, please share the updated code and any additional error messages you encounter.

Looking forward to your response so we can assist you further!

[kk26nav]

Thank you for your assitance.
if __name__ == "__main__": this helped me overcome that problem.
Could you also help me in getting the performance metrics after the model has been trained

[glenn-jocher]

Hi there! 😊

I'm glad to hear that the if __name__ == "__main__": fix helped you overcome the initial issue. Now, let's move on to getting the performance metrics after training your model.

To obtain performance metrics such as top-1 and top-5 accuracy after training your YOLOv8 classification model, you can use the val method. This method will validate your model on a specified dataset and provide you with the desired metrics.

Here's how you can do it:

Using Python

from ultralytics import YOLO

# Load your trained model
model = YOLO("path/to/your/trained_model.pt")

# Validate the model
metrics = model.val()  # No arguments needed if the model retains its training data and settings

# Print the performance metrics
print(f"Top-1 Accuracy: {metrics.top1:.2f}%")
print(f"Top-5 Accuracy: {metrics.top5:.2f}%")

Using CLI

# Validate your trained model
yolo classify val model=path/to/your/trained_model.pt

This will output the top-1 and top-5 accuracy metrics for your model on the validation dataset.

For more detailed information on validation and other tasks, you can refer to the Ultralytics documentation on classification.

If you have any more questions or need further assistance, feel free to ask. Happy training! 🚀

[Akshara211]

Hi,
How to use yoloV8 Image Classification model YOLOv8x-cls for video prediction on custom dataset.

[glenn-jocher]

@Akshara211 to use YOLOv8x-cls for video prediction on a custom dataset, load your model and process each video frame individually. You can use the predict function in a loop to classify each frame. For more details, refer to the YOLOv8 documentation.

[alganzory]

Is there a version trained on Open Images V7 like yolov8n-oiv7?
What if I wanna train this on a subset of OIV7? how do you recommend I do that?

[glenn-jocher]

@alganzory currently, there isn't a version trained on Open Images V7. To train on a subset of OIV7, you can prepare your dataset in the YOLO format and use the yolo train command with your custom data configuration. For more details, please refer to the Ultralytics documentation.

[skydiver1118]

Can yolov11 image classification on human facial expression like happy vs. sad? Thanks.

[glenn-jocher]

@skydiver1118 yes, YOLO11 can be used for classifying human facial expressions like happy vs. sad. You'll need to train a model on a labeled dataset of facial expressions. For more details, visit the YOLO11 classification documentation.

[jonthierry]

Hello YOLO team. Can I know which parts of the image that yolo classification model sees in form of heatmaps? Thanks. I basically want to answer the question why!

[glenn-jocher]

@jonthierry to visualize which parts of an image the YOLO classification model focuses on, you can use techniques like Grad-CAM to generate heatmaps. These methods highlight areas that contribute most to the model's predictions. For more details, you can explore resources on model interpretability.

[robert-hardman]

Hello
I achieved 65% accuracy in the previous model
But using the Yolo model, it reached 78%!
What is the structure and architecture of Yolo that has increased the accuracy with the yolo model?
What is your opinion about the train graph?

https://i.ibb.co/s3qZxCy/Figure-1.png
At which epoch should I stop training?
Note: My dataset has several classes and the number of images in the classes is different.

[glenn-jocher]

A validation loss of 1.5 may indicate room for improvement, but it's context-dependent. For detailed insights into YOLOv8's architecture, please refer to the official documentation.

[maxexplorer]

Hello,
In the YOLO classifier, the names dictionary is generated automatically, e.g., {0: 'empty', 1: 'full', 2: 'none'}. Is it possible to define custom keys for this dictionary manually?
Thank you for your work!

[glenn-jocher]

Currently, YOLO classification models automatically generate the names dictionary based on the dataset structure. To manually define custom keys, you would need to modify the training script or adjust the dataset loading process to align with your desired mapping.

[maxexplorer]

Hi there!
Thank you for your response! To clarify, I am looking for a way to explicitly define a custom names dictionary with specific key-value pairs for my YOLO classification model. For example, instead of the automatically generated mapping {0: 'empty', 1: 'full', 2: 'none'}, I want to manually define something like {10: 'empty', 20: 'full', 30: 'none'} with non-sequential or custom keys.

Is there a recommended way to achieve this by modifying the training script or dataset configuration, and could you provide more details or an example?

[glenn-jocher]

@maxexplorer currently, YOLO classification models automatically generate class mappings sequentially. To define custom keys like {10: 'empty', 20: 'full', 30: 'none'}, you can modify the names property of the model manually after training or adjust your dataset preprocessing to reflect this structure. However, this requires additional custom logic for compatibility during inference. For further details, feel free to consult the YOLO classification documentation.

[TJdeWet]

Hello, I keep getting this error when tuning a yolov8-cls classification model with wandb.

TensorBoard: model graph visualization added ✅
Image sizes 640 train, 640 val
Using 4 dataloader workers
Logging results to runs/classify/train3
Starting training for 136 epochs...

  Epoch    GPU_mem       loss  Instances       Size
  1/136      2.95G    0.06263         16        640: 100%|██████████| 263/263 [03:49<00:00,  1.15it/s]
           classes   top1_acc   top5_acc: 100%|██████████| 19/19 [05:12<00:00, 16.43s/it]
               all      0.937          1

Traceback (most recent call last):
File "/opt/conda/bin/yolo", line 8, in
sys.exit(entrypoint())
File "/opt/conda/lib/python3.10/site-packages/ultralytics/cfg/init.py", line 969, in entrypoint
getattr(model, mode)(**overrides) # default args from model
File "/opt/conda/lib/python3.10/site-packages/ultralytics/engine/model.py", line 802, in train
self.trainer.train()
File "/opt/conda/lib/python3.10/site-packages/ultralytics/engine/trainer.py", line 207, in train
self._do_train(world_size)
File "/opt/conda/lib/python3.10/site-packages/ultralytics/engine/trainer.py", line 453, in _do_train
self.run_callbacks("on_fit_epoch_end")
File "/opt/conda/lib/python3.10/site-packages/ultralytics/engine/trainer.py", line 168, in run_callbacks
callback(self)
File "/opt/conda/lib/python3.10/site-packages/ultralytics/utils/callbacks/raytune.py", line 17, in on_fit_epoch_end
if ray.train._internal.session._get_session(): # replacement for deprecated ray.tune.is_session_enabled()
AttributeError: module 'ray.train._internal.session' has no attribute '_get_session'. Did you mean: 'get_session'?
Sentry is attempting to send 2 pending events
Waiting up to 2 secondstuning

Additional

Environment information:
I am using kaggle...
PyTorch version: 2.0.0
CUDA available: True
Using GPU: Tesla P100-PCIE-16GB
Ultralytics version: 8.3.36

Basic code:
import os
!pip install --upgrade wandb
import wandb
from kaggle_secrets import UserSecretsClient
user_secrets = UserSecretsClient()
secret_value_0 = user_secrets.get_secret("wandb")
wandb.login(key=secret_value_0)
os.environ["WANDB_AGENT_MAX_INITIAL_FAILURES"] = "1"

!pip install -U ultralytics

from ultralytics import YOLO
from pathlib import Path
import random
import torch
sweep_config = {}
def train():
wandb.init(config=default_config)
config = wandb.config
lr0 = config.lr0
epochs = config.epochs
optimizer = config.optimizer
batch = config.batch
momentum = config.momentum
model = YOLO('yolov8n-cls.pt')
model.train(data='/kaggle/input/..', batch=batch, lr0=lr0, epochs=epochs, save_period=10,seed=42, optimizer = optimizer, momentum = momentum, imgsz=640, amp=True)

wandb.agent(sweep_id, train, count=10).

[glenn-jocher]

@TJdeWet the error appears to stem from a mismatch in the ray library, specifically in the ray.train._internal.session module. Updating the ray library to the latest version should resolve this issue. Use the following command to update:

pip install --upgrade ray

If the issue persists, please confirm that your environment is correctly set up and consistent with the latest requirements. For further guidance, you can consult the YOLO Common Issues page. Let us know if you encounter further challenges!

[trungnb34]

I have an issue when exporting with batch
Here is my code to export to ncnn classification model

from ultralytics import YOLO
model = YOLO("classify/train3/weights/best.pt")
model.export(format="ncnn", imgsz=224, half=True, batch=2)

After that, I am trying to run a sample code that is generated when exporting the model

import numpy as np
import ncnn
import torch

def test_inference():
    torch.manual_seed(0)
    in0 = torch.rand(2, 3, 224, 224, dtype=torch.float)
    out = []

    with ncnn.Net() as net:
        net.load_param("classify/train3/weights/best_ncnn_model/model.ncnn.param")
        net.load_model("classify/train3/weights/best_ncnn_model/model.ncnn.bin")

        with net.create_extractor() as ex:
            ex.input("in0", ncnn.Mat(in0.squeeze(0).numpy()).clone())

            _, out0 = ex.extract("out0")
            out.append(torch.from_numpy(np.array(out0)).unsqueeze(0))

    if len(out) == 1:
        return out[0]
    else:
        return tuple(out)

if __name__ == "__main__":
    print(test_inference())

But it crashed.

zsh: segmentation fault  /usr/local/bin/python3 classify/train3/weights/best_ncnn_model/model_ncnn.py

I want to know what is a solution to fix it ???
Thanks, everyone

[glenn-jocher]

@trungnb34 the segmentation fault likely occurs because NCNN does not support batch inference for classification models. Please try setting batch=1 during export and update the inference script to process one sample at a time. For further details on export formats and supported arguments, refer to the Ultralytics Export Documentation.

[kalpak25github]

Ultralytics 8.3.58 🚀 Python-3.10.12 torch-2.5.1+cu121 CPU (Intel Xeon 2.20GHz)
engine/trainer: task=classify, mode=train, model=yolo11n-cls.pt, data=/content/drive/MyDrive/classify, epochs=100, time=None, patience=100, batch=16, imgsz=64, save=True, save_period=-1, cache=False, device=None, workers=8, project=None, name=train25, exist_ok=False, pretrained=True, optimizer=auto, verbose=True, seed=0, deterministic=True, single_cls=False, rect=False, cos_lr=False, close_mosaic=10, resume=False, amp=True, fraction=1.0, profile=False, freeze=None, multi_scale=False, overlap_mask=True, mask_ratio=4, dropout=0.0, val=True, split=val, save_json=False, save_hybrid=False, conf=None, iou=0.7, max_det=300, half=False, dnn=False, plots=True, source=None, vid_stride=1, stream_buffer=False, visualize=False, augment=False, agnostic_nms=False, classes=None, retina_masks=False, embed=None, show=False, save_frames=False, save_txt=False, save_conf=False, save_crop=False, show_labels=True, show_conf=True, show_boxes=True, line_width=None, format=torchscript, keras=False, optimize=False, int8=False, dynamic=False, simplify=True, opset=None, workspace=None, nms=False, lr0=0.01, lrf=0.01, momentum=0.937, weight_decay=0.0005, warmup_epochs=3.0, warmup_momentum=0.8, warmup_bias_lr=0.1, box=7.5, cls=0.5, dfl=1.5, pose=12.0, kobj=1.0, nbs=64, hsv_h=0.015, hsv_s=0.7, hsv_v=0.4, degrees=0.0, translate=0.1, scale=0.5, shear=0.0, perspective=0.0, flipud=0.0, fliplr=0.5, bgr=0.0, mosaic=1.0, mixup=0.0, copy_paste=0.0, copy_paste_mode=flip, auto_augment=randaugment, erasing=0.4, crop_fraction=1.0, cfg=None, tracker=botsort.yaml, save_dir=runs/classify/train25
train: /content/drive/MyDrive/classify/train... found 4813 images in 5 classes ✅
val: None...
test: None...
Overriding model.yaml nc=80 with nc=5

               from  n    params  module                                       arguments                     

0 -1 1 464 ultralytics.nn.modules.conv.Conv [3, 16, 3, 2]
1 -1 1 4672 ultralytics.nn.modules.conv.Conv [16, 32, 3, 2]
2 -1 1 6640 ultralytics.nn.modules.block.C3k2 [32, 64, 1, False, 0.25]
3 -1 1 36992 ultralytics.nn.modules.conv.Conv [64, 64, 3, 2]
4 -1 1 26080 ultralytics.nn.modules.block.C3k2 [64, 128, 1, False, 0.25]
5 -1 1 147712 ultralytics.nn.modules.conv.Conv [128, 128, 3, 2]
6 -1 1 87040 ultralytics.nn.modules.block.C3k2 [128, 128, 1, True]
7 -1 1 295424 ultralytics.nn.modules.conv.Conv [128, 256, 3, 2]
8 -1 1 346112 ultralytics.nn.modules.block.C3k2 [256, 256, 1, True]
9 -1 1 249728 ultralytics.nn.modules.block.C2PSA [256, 256, 1]
10 -1 1 336645 ultralytics.nn.modules.head.Classify [256, 5]
YOLO11n-cls summary: 151 layers, 1,537,509 parameters, 1,537,509 gradients, 3.3 GFLOPs
Transferred 234/236 items from pretrained weights
TensorBoard: Start with 'tensorboard --logdir runs/classify/train25', view at http://localhost:6006/
train: Scanning /content/drive/MyDrive/classify/train... 4813 images, 0 corrupt: 100%|██████████| 4813/4813 [00:00<?, ?it/s]

TypeError Traceback (most recent call last)
in <cell line: 7>()
5
6 # Train the model
----> 7 results = model.train(data='/content/drive/MyDrive/classify', epochs=100, imgsz=64)

11 frames
/usr/lib/python3.10/posixpath.py in expanduser(path)
230 """Expand ~ and user constructions. If user or $HOME is unknown,
231 do nothing."""
--> 232 path = os.fspath(path)
233 if isinstance(path, bytes):
234 tilde = b''

TypeError: expected str, bytes or os.PathLike object, not NoneType

[glenn-jocher]

@kalpak25github the error indicates that the data argument in your model.train() call is not being correctly interpreted. Ensure you provide the path to a dataset YAML file (e.g., data="path/to/dataset.yaml") instead of a directory path. Refer to the dataset format guide for proper setup: https://docs.ultralytics.com/datasets/classify/. Let me know if you need further clarification!

[kalpak25github]

Ultralytics 8.3.58 🚀 Python-3.10.12 torch-2.5.1+cu121 CPU (Intel Xeon 2.20GHz)
engine/trainer: task=classify, mode=train, model=yolo11x-cls.pt, data=/content/drive/MyDrive/war_events/data.yaml, epochs=100, time=None, patience=20, batch=16, imgsz=128, save=True, save_period=-1, cache=False, device=None, workers=8, project=/content/drive/MyDrive/war_events, name=train13, exist_ok=False, pretrained=True, optimizer=auto, verbose=True, seed=0, deterministic=True, single_cls=False, rect=False, cos_lr=False, close_mosaic=10, resume=False, amp=True, fraction=1.0, profile=False, freeze=None, multi_scale=False, overlap_mask=True, mask_ratio=4, dropout=0.0, val=True, split=val, save_json=False, save_hybrid=False, conf=None, iou=0.7, max_det=300, half=False, dnn=False, plots=True, source=None, vid_stride=1, stream_buffer=False, visualize=False, augment=False, agnostic_nms=False, classes=None, retina_masks=False, embed=None, show=False, save_frames=False, save_txt=False, save_conf=False, save_crop=False, show_labels=True, show_conf=True, show_boxes=True, line_width=None, format=torchscript, keras=False, optimize=False, int8=False, dynamic=False, simplify=True, opset=None, workspace=None, nms=False, lr0=0.01, lrf=0.01, momentum=0.937, weight_decay=0.0005, warmup_epochs=3.0, warmup_momentum=0.8, warmup_bias_lr=0.1, box=7.5, cls=0.5, dfl=1.5, pose=12.0, kobj=1.0, nbs=64, hsv_h=0.015, hsv_s=0.7, hsv_v=0.4, degrees=0.0, translate=0.1, scale=0.5, shear=0.0, perspective=0.0, flipud=0.0, fliplr=0.5, bgr=0.0, mosaic=1.0, mixup=0.0, copy_paste=0.0, copy_paste_mode=flip, auto_augment=randaugment, erasing=0.4, crop_fraction=1.0, cfg=None, tracker=botsort.yaml, save_dir=/content/drive/MyDrive/war_events/train13

Dataset not found ⚠️, missing path /content/drive/MyDrive/war_events/data.yaml, attempting download...
Dataset download success ✅ (0.0s), saved to /content/drive/MyDrive/war_events/data.yaml

Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/ultralytics/engine/trainer.py", line 555, in get_dataset
data = check_cls_dataset(self.args.data)
File "/usr/local/lib/python3.10/dist-packages/ultralytics/data/utils.py", line 449, in check_cls_dataset
names = [x.name for x in (data_dir / "train").iterdir() if x.is_dir()] # class names list
File "/usr/local/lib/python3.10/dist-packages/ultralytics/data/utils.py", line 449, in
names = [x.name for x in (data_dir / "train").iterdir() if x.is_dir()] # class names list
File "/usr/lib/python3.10/pathlib.py", line 1017, in iterdir
for name in self._accessor.listdir(self):
NotADirectoryError: [Errno 20] Not a directory: '/content/drive/MyDrive/war_events/data.yaml/train'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/bin/yolo", line 8, in
sys.exit(entrypoint())
File "/usr/local/lib/python3.10/dist-packages/ultralytics/cfg/init.py", line 973, in entrypoint
getattr(model, mode)(**overrides) # default args from model
File "/usr/local/lib/python3.10/dist-packages/ultralytics/engine/model.py", line 800, in train
self.trainer = (trainer or self._smart_load("trainer"))(overrides=args, _callbacks=self.callbacks)
File "/usr/local/lib/python3.10/dist-packages/ultralytics/models/yolo/classify/train.py", line 40, in init
super().init(cfg, overrides, _callbacks)
File "/usr/local/lib/python3.10/dist-packages/ultralytics/engine/trainer.py", line 133, in init
self.trainset, self.testset = self.get_dataset()
File "/usr/local/lib/python3.10/dist-packages/ultralytics/engine/trainer.py", line 566, in get_dataset
raise RuntimeError(emojis(f"Dataset '{clean_url(self.args.data)}' error ❌ {e}")) from e
RuntimeError: Dataset '/content/drive/MyDrive/war_events/data.yaml' error ❌ [Errno 20] Not a directory: '/content/drive/MyDrive/war_events/data.yaml/train'
Sentry is attempting to send 2 pending events
Waiting up to 2 seconds
Press Ctrl-C to quit

and this my yaml file

train: /content/drive/MyDrive/war_events/train
val:
test:

nc: 5
names: ['Combat', 'DestroyedBuildings','Fire','Humanitarian_Aid_and_rehabilitation','Military_vehicles _and _weapons']

[glenn-jocher]

@kalpak25github the error occurs because the data.yaml file is being treated as a directory instead of a configuration file. Ensure that your data.yaml is correctly formatted and points to valid directories for train, val, and test. For example:

train: /content/drive/MyDrive/war_events/train
val: /content/drive/MyDrive/war_events/val
test: /content/drive/MyDrive/war_events/test

nc: 5
names: ['Combat', 'DestroyedBuildings', 'Fire', 'Humanitarian_Aid_and_rehabilitation', 'Military_vehicles_and_weapons']

Make sure the specified directories exist and are structured properly for classification, with subdirectories for each class containing the respective images. For more details, refer to the dataset guide: https://docs.ultralytics.com/datasets/classify/. Let me know if you need further assistance!

[antonio-napolitano]

I´m training a YOLO11 model for classification and had some questions:

1. Given the following code for training:

   !pip install ultralytics
   from ultralytics import YOLO
   import os
   import torch
   import torch.distributed as dist
   def init_distributed_mode():
   if not dist.is_initialized():
   if 'RANK' in os.environ and 'WORLD_SIZE' in os.environ:
   rank = int(os.environ['RANK'])
   world_size = int(os.environ['WORLD_SIZE'])
   dist_backend = 'nccl' # or 'gloo' for CPU training
   dist.init_process_group(backend=dist_backend, init_method='env://')
   torch.cuda.set_device(rank)
   print(f"Distributed training enabled with {world_size} processes")
   else:
   print("Distributed training not enabled")
   else:
   print("Distributed process group is already initialized.")

   Change the directory

   os.chdir("path to directory")
   output_directory = 'path to directory'
   pretrained_weights = "path to yolo11x-cls.pt"

   Initialize the model

   model = YOLO(pretrained_weights)

   Initialize distributed mode

   init_distributed_mode()

   Train the model

   results = model.train(data=output_directory, epochs=300, pretrained=pretrained_weights,save_period=10)

   If I initialize the model with the pretrained weights, then can I avoid the pretrained argument in the model.train() function? At some point in the output it says:

   " Downloading https://github.com/ultralytics/assets/releases/download/v8.3.0/yolo11n.pt to 'yolo11n.pt'... "
   so I´m scared that it is using those weights instead of the ones I gave him.

   2. How is the model choosing the best epoch during the training process. Based on my experiments, it seems it is NOT doing it based on the validation loss. Is it doing it based on the validation accuracy? Is there a way to customize and choose that?

   3. How is the model setting the threshold for classifying the images for building the confusion matrix on the validation set? Changing the conf argument in the model.train() function doesn´t seem to change the confusion matrix (I also tried extreem values like 1), so I don´t get how I can modify it

[glenn-jocher]

@antonio-napolitano 1. If you've initialized the model with pretrained weights using YOLO(pretrained_weights), you don't need to specify the pretrained argument in train(). If the model downloads yolo11n.pt, ensure your pretrained_weights path is correct and accessible.

2. The best epoch is chosen based on validation accuracy (top1 accuracy for classification). Customizing this metric is not currently supported in YOLO11.

3. The threshold in the confusion matrix for classification tasks is not adjustable, as classification outputs a single class with the highest confidence by default, unlike detection tasks where conf is used.

[antonio-napolitano]

Thanks a lot for the clear answer!
Regarding point 2: my data (I remind that it is a binary classification problem) are very unbalanced towards one class. Therefore the accuracy is not a valid metric to use to validate the model I suppose. I thought of saving every 10 epochs from 0 to 300 and than one of the following two :

1. Manually choose the best model using the area under the precision-recall curve and compare it among the different epochs
2. Choosing the best model comparing the validation loss over the different epochs. But I don't know how the validation loss is defined and therefore I don't know if it is suitable for unbalanced validation sets.
   Do you have any suggestions on which procedure to follow among the two?
   thanks !

[glenn-jocher]

Thank you for your detailed question! For imbalanced datasets, your approach of analyzing models across epochs is valid. Between the two options, using the area under the precision-recall curve (Option 1) is generally better for imbalanced data, as it directly evaluates model performance without being skewed by class imbalance. Regarding validation loss (Option 2), it is computed from the cross-entropy loss, which may still reflect class imbalance depending on your dataset distribution. You might also consider using metrics like F1-score or weighted loss during evaluation for better insights.

[maxexplorer]

Hello,
When I use a classifier, all images in my dataset are approximately 380x180 in size. Is there any point in using a larger size, such as imgsz=640, during training?

[glenn-jocher]

Using a larger imgsz like 640 may not provide significant benefits if your dataset images are consistently around 380x180, as resizing beyond their native resolution can introduce unnecessary interpolation artifacts without improving classification performance. It's generally better to use an imgsz closer to your dataset's resolution for optimal results.

[infrunami22]

Is it possible to use an object detection model for classification? I would like to test my model in an application that does classification only and the model I have was trained for object detection.

[glenn-jocher]

@infrunami22 thank you for your question! While object detection models aren't optimized for pure classification tasks, you can achieve basic classification by using the detected class labels from bounding boxes. For optimal classification performance, we recommend using YOLO11 Classify models specifically designed for this purpose, like yolo11n-cls.pt, which output single-class predictions with confidence scores. You can find implementation examples in the Image Classification documentation. For detection-based classification, you might extract the dominant class from detection results using results[0].names[results[0].probs.top1].

[test726]

Hey! Junior here. Does size=224 means this model can only be trained using 224x224? So, if have dataset of 640x40 I need resize it? Also, does this hold same during inference?

[glenn-jocher]

@test726 hi there! For non-uniform resolutions in your scanned documents, you can use any imgsz value that fits your needs - YOLO automatically resizes images while maintaining aspect ratio during training and inference. There's no requirement for 1:1 aspect ratio. The model will handle padding as needed. For optimal results, consider choosing an imgsz that balances your document details with computational efficiency. More details are available in the Dataset Guide.

[test726]

Thank you for your explanation. Also, I would like to confirm if Yolov11-cls can be used to separate document types like emails, Ads, IDs, and so on.

[glenn-jocher]

Yes, YOLO11-cls can classify document types like emails, ads, and IDs when trained on a custom dataset with these classes. Simply structure your dataset following the YOLO classification format and train with model.train(). For dataset setup details, see the Classification Dataset Guide.

[test726]

Okay. I have trained Yolov11-cls on a custom dataset. However, I am having some trouble interpreting the results.

from ultralytics import YOLO

Load a model

model = YOLO("yolo11n-cls.pt") # load an official model
model = YOLO("path/to/best.pt") # load a custom model

Predict with the model

results = model("https://ultralytics.com/images/bus.jpg") # predict on an image

print(results)

When I ran this above code, I got the results, however, when I try to print the results variable, I didn't get confidence score as a output stored in it:

Output:

boxes: None
keypoints: None
masks: None
names: {0: 'BalanceSheets', 1: 'CashFlow', 2: 'IncomeStatement', 3: 'Notes', 4: 'Others'}
obb: None
orig_img: array([[[255, 255, 255],
[255, 255, 255],
[255, 255, 255],
...,
[255, 255, 255],
[255, 255, 255],
[255, 255, 255]],

   [[255, 255, 255],
    [255, 255, 255],
    [255, 255, 255],
    ...,
    [255, 255, 255],
    [255, 255, 255],
    [255, 255, 255]],

   [[255, 255, 255],
    [255, 255, 255],
    [255, 255, 255],
    ...,
    [255, 255, 255],
    [255, 255, 255],
    [255, 255, 255]],

   ...,

   [[255, 255, 255],
    [255, 255, 255],
    [255, 255, 255],
    ...,
    [255, 255, 255],
    [255, 255, 255],
    [255, 255, 255]],

   [[255, 255, 255],
    [255, 255, 255],
    [255, 255, 255],
    ...,
    [255, 255, 255],
    [255, 255, 255],
    [255, 255, 255]],

   [[255, 255, 255],
    [255, 255, 255],
    [255, 255, 255],
    ...,
    [255, 255, 255],
    [255, 255, 255],
    [255, 255, 255]]], dtype=uint8)

orig_shape: (1024, 898)
path: 'C:\Users\krispy\Desktop\classify\app\phpdQXsCD-3c3af916d04a4afaade345b53094231c.png'
probs: ultralytics.engine.results.Probs object
save_dir: 'runs\classify\predict'
speed: {'preprocess': 62.730900001042755, 'inference': 572.3241000014241, 'postprocess': 0.08259999958681874}]

[glenn-jocher]

Hi there! For classification confidence scores, access results[0].probs.top1conf to get the top confidence value and results[0].names for class names. The Predict page shows how to work with classification outputs. Let us know if you need more help! 😊

[test726]

While running validation code, I encountered this error: Ultralytics 8.3.99 🚀 Python-3.13.2 torch-2.6.0+cpu CPU (Intel Core(TM) i3-3220T 2.80GHz) YOLO11s summary (fused): 100 layers, 9,419,766 parameters, 0 gradients, 21.3 GFLOPs Traceback (most recent call last): File "c:\Users\User\Desktop\classify\invoice\val.py", line 8, in <module> metrics = model.val() # no arguments needed, dataset and settings remembered File "C:\Users\krispy\Desktop\classify\invoice\.venv\Lib\site-packages\ultralytics\engine\model.py", line 628, in val validator(model=self.model) ~~~~~~~~~^^^^^^^^^^^^^^^^^^ File "C:\Users\User\Desktop\classify\invoice\.venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) File "C:\Users\User\Desktop\classify\invoice\.venv\Lib\site-packages\ultralytics\engine\validator.py", line 179, in __call__ self.data = check_det_dataset(self.args.data) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^ File "C:\Users\User\Desktop\classify\invoice\.venv\Lib\site-packages\ultralytics\data\utils.py", line 312, in check_det_dataset file = check_file(dataset) File "C:\Users\krispy\Desktop\classify\invoice\.venv\Lib\site-packages\ultralytics\utils\checks.py", line 546, in check_file raise FileNotFoundError(f"'{file}' does not exist") FileNotFoundError: '/content/datasets/invoice/data.yaml' does not exist It says '/content/datasets/invoice/data.yaml' does not exist so I created a content folder inside my project and then datasets, invoice, and finally pasted data.yml inside invoice. However, I think the confusion lies in '/content/datasets/invoice/data.yaml' vs 'content/datasets/invoice/data.yaml'. '

…

On Mon, Mar 31, 2025 at 1:04 AM Glenn Jocher ***@***.***> wrote: Hi there! For classification confidence scores, access results[0].probs.top1conf to get the top confidence value and results[0].names for class names. The Predict page shows how to work with classification outputs. Let us know if you need more help! 😊 — Reply to this email directly, view it on GitHub <#7960 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BLSKYGZOZAFWC5334JZBAUT2XA7UVAVCNFSM6AAAAABCV6KUCGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTENRWHEZTAOI> . You are receiving this because you were mentioned.Message ID: ***@***.*** com>

[glenn-jocher]

@test726 hi there! For classification validation, ensure your dataset follows the YOLO classification format (no YAML needed) and use the correct relative path to your dataset folder. The CLI command should be `yolo classify val model=path/to/

[test726]

Okay thank you for the clarification. What about object detection model then? Also, I have another question for you. Earlier you said the model will convert the input images to its requirement size i.e. 224. So, the time to train a model using 2000x2000 documents and 224x2224 documents would be the same? I also wonder why the input image is expected to be a square (having same width and height).

…

On Mon, Mar 31, 2025 at 9:30 PM Glenn Jocher ***@***.***> wrote: @test726 <https://github.com/test726> hi there! For classification validation, ensure your dataset follows the YOLO classification format (no YAML needed) and use the correct relative path to your dataset folder. The CLI command should be `yolo classify val model=path/to/ — Reply to this email directly, view it on GitHub <#7960 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BLSKYGZ4LLHHD632OANCSED2XFPI5AVCNFSM6AAAAABCV6KUCGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTENRXHA2DKMY> . You are receiving this because you were mentioned.Message ID: ***@***.*** com>

[glenn-jocher]

@test726 hi there! For object detection models, you can explore the available options and usage details in the Object Detection models section of our documentation.

Regarding image sizes: Training time depends on the target input size (like 224x224), not original image dimensions, as images are resized during preprocessing. Square inputs simplify model architecture and improve efficiency in convolutional operations while maintaining aspect ratio through letterboxing. 😊

[pax7]

is classify train only working on a single GPU?

[pax7]

this may be related to this error

libibverbs: Warning: couldn't load driver 'libvmw_pvrdma-rdmav34.so': libvmw_pvrdma-rdmav34.so: cannot open shared object file: No such file or directory

because I am stuck on one GPU no matter what the task is - any ideas?

[glenn-jocher]

Hi @pax7,

YOLO classification training does support multi-GPU functionality through Distributed Data Parallel (DDP). The error you're seeing with libibverbs is related to the RDMA communication system often used for high-speed GPU-to-GPU communication.

This warning typically doesn't prevent multi-GPU training but might affect performance. To address your specific issues:

1. To enable multi-GPU training, you can use the following command:

   # For CLI
   yolo classify train model=yolo11n-cls.pt data=path/to/dataset device=0,1,2,3
   
   # For Python
   from ultralytics import YOLO
   model = YOLO("yolo11n-cls.pt")
   model.train(data="path/to/dataset", device=[0,1,2,3])

2. For the libibverbs warning, this is often just a warning rather than an error. If you're still experiencing issues with multi-GPU training, you might want to:

   • Ensure your PyTorch installation includes CUDA support
   • Update your NVIDIA drivers
   • Check that your system has the necessary networking packages installed

You can also try setting the environment variable NCCL_P2P_DISABLE=1 before running your training to use a different communication method.

Let me know if these suggestions help with your multi-GPU training!

[Ranjith3436]

I am trying to train classification model. why you prefer you architecture. why don't you move transformer architecture? is it capable than ViT.