Fable和Astra无法观看视频,只能检查帧。这实际上可以
查看原文
原帖正文
Fable and Astra can’t watch video, they can only inspect frames. This actually can
引用自 X
原帖地址:https://x.com/i/status/2123533699899888030
原帖:
我微调了qwen3-vl 8b,让它可以观看视频并告诉你镜头是如何拍摄的。我称之为镜头阅读器。摄像机的高度、镜头、角度、摄像机的移动方式。谁在画面中,他们站在哪里,他们走到哪里。事实证明,这对人工智能来说很难。即使是opus 5.5和gemini 4,使用专门为反向工程镜头而编写的提示,获得相机高度和正确移动两者所需的时间不到一半。开箱即用模型:5%。Shot Reader 的准确率为 69%。它比 opus 快 2.4 倍,便宜约 30 倍,而且体积小巧,可以在您自己的 GPU 上运行。为什么这很重要:人工智能已经可以编写Blender代码。拍好一张照片,首先要读懂它。看一个镜头 → 获得计划 → 以3D形式重建它,重新拍摄它,重新混音它。在hugging face上打开权重,链接如下。
查看引用原文
i fine-tuned qwen3-vl 8b to watch a video and tell you how the shot was made. i'm calling it shot reader.camera height, lens, angle, how the camera moves. who's in frame, where they stand, where they walk.turns out that's hard for ai. even opus 5.5 and gemini 4, with a prompt written specifically to reverse-engineer shots, get the camera height and move both right less than half the time. open models out of the box: 5%.shot reader gets 69%. it's 2.4x faster than opus, ~30x cheaper, and small enough to run on your own gpu.why it matters: ai can already write blender. getting a shot right starts with reading it.see a shot → get the plan → rebuild it in 3d, reshoot it, remix it.open weights on hugging face, link below.
0 条评论
登录后可以参与讨论。
成员登录还没有评论。第一条认真回应会很重要。