Lightricks 开源实时视频生成模型 LTX-Video，该模型有哪些功能？未来将用于哪些场景？

最近开源视频领域又迎来了一片黑马：LTX-Video，一个字：快，生成视频的速度相当快。

官方宣称是视频速度比观看视频的速度还要快，生成一个 768x512 分辨率 24 FPS 的 5 秒时长的视频只需要 4 秒。

听雨试了下虽然不是啥配置都能达到这个速度，不过的确很快，4090 只需要 15s，Flux 画一张图也差不多需要这个时间了，可以想象速度真的是很快！视频也可以无限抽卡的时代来了！

并且不只是单纯快，显存占用也是相当少，只需要 8G 显存就可以完美运行，最主要的是视频质量也不差。

好了，话不多说，我们直接开整！

先来看效果，文末介绍如何使用。

提示词：The golden sun casts a warm glow over the vast, rolling wheat field, as the wind gently rustles through the golden stalks. The field stretches out in all directions, with the occasional tree or farmhouse dotting the landscape. The sky is ablaze with hues of orange and pink, reflecting off the distant horizon. The scene is one of serene beauty, with the soft hum of insects and the whisper of the wind.

提示词： A tranquil lake mirrors the surrounding autumn forest, its surface a canvas of reflected oranges, reds, and yellows from the trees. The lake is still, with only the occasional ripple from a fish breaking the surface. The forest is dense with deciduous trees, their leaves creating a colorful mosaic on the ground. The air is crisp and cool, carrying the scent of fallen leaves and damp earth.

提示词：A misty morning envelops a serene mountain valley, with a thin veil of fog hovering just above the dew-kissed grass. The valley is surrounded by majestic peaks, their tops shrouded in clouds. The sun is just beginning to rise, casting a soft, ethereal light that pierces through the mist. The sound of a gentle stream can be heard in the distance, and the air is fresh and crisp. The scene is one of untouched natural beauty, a peaceful haven away from the hustle and bustle of the world.

提示词：The soft patter of snow against the windows is the only sound that breaks the silence in the quiet library interior. The scene is dominated by the warm, inviting glow of the library lamps against the backdrop of a raging snowstorm outside. The bookshelves are lined with leather-bound tomes, their spines a testament to the knowledge and stories they hold. A solitary p sits at a wooden table, engrossed in a book, the flickering light casting shadows that dance across the pages. The scene evokes a sense of comfort and refuge amidst the chaos of the storm outside.

提示词：A close-up shot of a young woman's face during sunset, with soft lighting highlighting her features. Her eyes well up with tears, and her lips quiver slightly, revealing suppressed emotions. The camera gradually zooms in, emphasizing the fine details of her face, finally focusing on her tear-filled eyes.

提示词：A woman with long brown hair and light skin smiles at another woman with long blonde hair. The woman with brown hair wears a black jacket and has a small, barely noticeable mole on her right cheek. The camera angle is a close-up, focused on the woman with brown hair's face. The lighting is warm and natural, likely from the setting sun, casting a soft glow on the scene. The scene appears to be real-life footage.

提示词：An elderly man with a white beard and kind eyes sits on a porch, rocking gently in a wooden chair. He wears a tweed jacket and a worn-out fedora, his hands resting on a walking cane. The camera focuses on his face as he gazes out at the sunset, his expression a mix of nostalgia and contentment. The background is a blur of a small town street, with vintage cars and pedestrians in old-fashioned attire, capturing a bygone era.

提示词：A young artist, with wild, untamed hair and intense eyes, stands at the edge of the sea, his hands moving with fervent strokes across the canvas. The wind whips his paint-splattered smock as he captures the essence of the crashing waves and the vast, open sky. The camera focuses on his face, etched with concentration, as the sunlight glints off his glasses. The scene is filled with the sounds of the sea and the occasional squawk of seagulls, creating a backdrop for the artist's creative journey.

虽然文生视频没有 CogVideoX 和 Mochi 稳定，但胜在速度真的很快，画一张图的速度，视频就出来了， 4090 基本十几秒就可以出视频。

不稳定也可以以量取胜，不过 LTX-Video 对提示词的要求也比较高，提示词越详细出图质量越高。

而且尽量不要太大幅度的动作，比如跑呀跳呀，出来的画面很容易扭曲。

文生图看完了，我们来试试图生视频吧！

提示词：The train slowly moves forward

提示词：In an oil painting inspired by the romanticism of maritime landscapes, we find ourselves gazing upon a solitary lighthouse as it stands tall against a backdrop of smoky shades during sunset. The lighthouse's weathered facade is rendered with expert brushstrokes and rich textures, its details subtly highlighted by the warm glow cast from strip lighting that illuminates the structure. As twilight descends upon the scene, the sky transitions into a breathtaking array of oranges, pinks, and purples as they blend together in the distance. The calm waters below shimmer with the remnants of daylight, while the lighthouse's beacon flickers gently amidst the twilight. This oil painting captures the enchanting beauty and nostalgic charm of a sunset scene at a secluded lighthouse in rich, evocative colors that draw viewers into its dreamy embrace.

提示词：Capture a cinematic, sexy female Saiyan with gradient, cloud-like hair. She's dressed in a vintage tea-length dress adorned with floral patterns and a lace collar. Utilize a dolly zoom to focus on her as she stands at a seaside marina, with the Arnold Schoenberg-inspired style emphasizing intricate details. The Nikon D850 camera and bloom light technique enhance the image's allure.The wind flutters her hair, adding a dynamic touch to the scene. As she slowly turns to the left, her eyes blink, conveying a moment of natural grace and anticipation.

图生视频和文生视频的生成时间都差不多，也都是十几秒，生成速度上没啥好讲的，但是的确很吃提示词。和文生视频也是一样的问题，动作幅度不能过大。

但是这个生成速度可以出来这种效果真的已经是相当不错了，后续如果有其他的微调版本或者动态 Lora 加持，听雨觉得 LTX-Video 绝对是 AI 视频大模型开源领域的一匹黑马，让我们期待一下吧！

想要使用 LTX-Video 也很简单，ComfyUI 官方已经支持 LTX-Video，我们只需要把 ComfyUI 本体更新到最新版本就可以了。需要用到的模型和工作流听雨已经放在网盘里了，需要的小伙伴自取。

至于提示词的问题，可以交给 ChatGPT 或者 kimi 进行仿写。

好了，今天的分享就到这里了，想要尝鲜的小伙去可以去试试！

网盘地址：https://pan.quark.cn/s/809ad75c0b03

我是听雨，专注于 AI 绘画以及 AI 工具分享，更多内容可以进我的个人主页查看，欢迎来一起交流。

如果觉得文章有帮助，请帮忙点赞收藏关注一下呦~