Technology

diffusion models

6 synchronized stories carry this tag.

Pika H3 Flex opens six-step video-and-audio generation for local use

Pika released H3 Flex, a post-trained MiniMax H3 model family that generates video with synchronized audio in six sampling steps. Public weights, code and documented paths cover text-to-video, first- and last-frame generation, and reference-conditioned video at native 480p or 768p with up to 12 image, video or audio references.

Why it matters: The release gives video teams an inspectable local path for rapid multimodal iteration instead of limiting the workflow to a hosted creator. The useful boundary is narrower than the launch headline: local artifacts are adapters derived from MiniMax H3, while…

Read storyOriginal source · pika.art

Qwen releases an eight-step Image 2.1 Turbo checkpoint and hosted APIs

Qwen released Qwen-Image-2.1-Turbo, a 7B visual-generation checkpoint for text-to-image and editing in eight denoising steps. The checkpoint carries its sampling schedule, uses prefix KV caching and loads through Diffusers; Qwen also made Pro and Turbo hosted APIs live.

Why it matters: The accelerated checkpoint creates a reproducible local alternative to the hosted image APIs while keeping generation and editing in one pipeline. Its eight-step target is an implementation fact, not proof that quality or total cost beats the base model on…

Read storyOriginal source · github.com

Kandinsky 6.0 opens synchronized audio-video models

Kandinsky Lab released code and checkpoints for Kandinsky 6.0 Video Lite (3B) and Pro (29B), which generate five-second video with synchronized 44 kHz audio from text or an input image. The release also includes a separate Full-HD super-resolution path and integrations with Diffusers, ComfyUI, vLLM-Omni, SGLang and FastVideo.

Why it matters: The release puts synchronized audio-video generation behind inspectable weights and several established inference stacks instead of a closed demo. Teams can now measure whether the smaller model, integration paths and super-resolution stage are practical for…

Read storyOriginal source · github.com

Google frames image-model steering as a lightweight control problem

Google Research published Diffusion Controller, a control-theoretic framework that leaves a diffusion backbone frozen and trains a side network to steer its denoising trajectory. Google reports stronger prompt-alignment and quality tradeoffs than its gray-box baselines and LoRA in Stable Diffusion 1.4 experiments.

Why it matters: The method separates the control layer from the image model and can work with exposed intermediate outputs rather than full model weights. That could make preference or policy adaptation cheaper, but one dated paper and provider-run evaluation do not…

Read storyOriginal source · research.google

FLUX.2 brings multi-reference image editing and generation to production APIs

Black Forest Labs released FLUX.2 Pro and Flex APIs plus FLUX.2 Dev weights, adding multi-reference conditioning, higher-resolution image generation, editing, and improved text and layout handling.

Why it matters: Image systems were moving from one-shot prompting toward controllable production workflows that preserve subjects, products, styles, and layouts across references.

Read storyOriginal source · bfl.ai

MatterGen turns materials discovery into a constrained generation problem

Microsoft published MatterGen, a diffusion model that generates inorganic crystal structures conditioned on chemistry, symmetry and physical-property targets. The Nature paper included one laboratory synthesis: the generated material’s measured bulk modulus was within 20% of the requested target. Microsoft also released the implementation, training data and fine-tuning data under MIT terms.

Why it matters: This replaces exhaustive screening of known candidates with inverse design: propose structures for the property you need, then validate them computationally and experimentally.

Read storyOriginal source · microsoft.com