Skip to yearly menu bar Skip to main content


Poster

Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D

Karran Pandey · Paul Guerrero · Matheus Gadelha · Yannick Hold-Geoffroy · Karan Singh · Niloy J. Mitra


Abstract:

We present a new training-free method for 3D-aware object edits on images using pretrained text-to-image diffusion models. 3D edits, like translation, rotation and scale, are implemented by lifting the activations of the diffusion model to 3D using depth information. In this paper, we present our method, followed by results on both real and generated images, and a comparative user study to position our method with respect to relevant work. We further illustrate compelling 3D applications of our method such as object editing in scenes and camera movement.

Live content is unavailable. Log in and register to view live content