I am a PhD student working on image and video generation and editing. I want diffusion and flow models to be controllable, and I want to understand what video models know about the world, so they can be used as world models and for reasoning.
My recent work is on joint audio-video diffusion models. Soundwich splits the generated audio into stems (speech, music, effects, ambience) that can be edited independently. Sound Sparks Motion edits motion at test time, without retraining the model.
Earlier I worked on 3D and 4D reconstruction at ETH Zurich and INSAIT, and on robot manipulation at the University of Toronto. I did my BSc at Sharif University of Technology, and worked at Tapsi on ETA and navigation models.
Elsewhere: GitHub · Scholar · LinkedIn · X · Medium