You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
add DTensor to VLE and fix 2D sharding group in EBC (#2626)
Summary:
Adding DTensor state dict to VLE, this is identical to EBC DTensor path.
Future work of this diff is to consolidate the logic of EBC/PEA/VLE state dict into one parent class because of their significant similarities
A revert diff removed the 2D sharding logic in embedding bag collection mistakenly: D66800554, this diff adds it back in
Differential Revision: D65555595
0 commit comments