Add video-to-video #1469
Open
Add video-to-video #1469
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
merveenoyan
requested review from
SBrandeis,
gary149,
Wauplin,
julien-c,
pcuenca and
ngxson
as code owners
Vaibhavs10
reviewed
May 20, 2025
Vaibhavs10
reviewed
May 20, 2025
packages/tasks/src/tasks/index.ts
Outdated
| @@ -111,6 +111,7 @@ export type { | |||
| } from "./zero-shot-object-detection/inference.js"; | |||
|
|
|||
| import type { ModelLibraryKey } from "../model-libraries.js"; | |||
| import { get } from "http"; | |||
There was a problem hiding this comment.
is this supposed to be here?
There was a problem hiding this comment.
idk where it came from lol thx for pointing out, fixed
Vaibhavs10
approved these changes
May 22, 2025
There was a problem hiding this comment.
Looks good to me! Do we have a list of models where this would already apply?
IIRC @linoytsaban had 10-12 models she was tracking!
|
@Vaibhavs10 this yields 62 models https://huggingface.co/search/full-text?q=video-to-video&type=model I'll open PRs |
pcuenca
reviewed
May 23, 2025
| @@ -111,7 +111,6 @@ export type { | |||
| } from "./zero-shot-object-detection/inference.js"; | |||
|
|
|||
| import type { ModelLibraryKey } from "../model-libraries.js"; | |||
|
|
|||
There was a problem hiding this comment.
idk it was linter :D
| @@ -248,6 +248,7 @@ export const TASKS_DATA: Record<PipelineType, TaskData | undefined> = { | |||
| translation: getData("translation", translation), | |||
| "unconditional-image-generation": getData("unconditional-image-generation", unconditionalImageGeneration), | |||
| "video-text-to-text": getData("video-text-to-text", videoTextToText), | |||
| "video-to-video": getData("video-to-video", placeholder), | |||
|
@Vaibhavs10 I opened the PRs, we can merge when some are merged |
|
merged main to this branch, it broke one test ^_^ |
Vaibhavs10
reviewed
May 23, 2025
|
Cool work! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adding video-to-video as task for models like following (h/t @NielsRogge)
https://github.com/alonzoleeeooo/stablev2v
https://huggingface.co/spaces/fffiloni/Pix2Pix-Video
https://huggingface.co/chestnutlzj/WF-VAE-L-16Chn
also cc @sayakpaul