Add oneCCL backend for idist

[vfdev-5]

🚀 Feature

The idea is to add "oneCCL" backend by extending our torch native dist model.

Any interest for that ?

Refs:

• https://pytorch.medium.com/optimizing-dlrm-by-using-pytorch-with-oneccl-backend-9f85b8ef6929
• https://github.com/intel/torch-ccl

[sdesrozis]

First, that seems pretty straightforward. Second, it is a perfect use case to show how idist can be extended.

I think that is a good idea. Point is : do we extend tests ?...

[Moh-Yakoub]

So is the scope of this task to

1. add the torch-ccl to the set of supported backends
2. Update the existing native dist model to allow using the new torch-ccl model
3. add the equivalent tests? @vfdev-5

[sdesrozis]

@Moh-Yakoub I think you got it.

[vfdev-5]

@sdesrozis @Moh-Yakoub I think it would be better to create a new comp model that inherits from native one.

[Moh-Yakoub]

@sdesrozis @Moh-Yakoub I think it would be better to create a new comp model that inherits from native one.

Let me prepare a WIP implementing that approach and we can take it from there.