Computer Vision News - October 2024

21 Computer Vision News Computer Vision News E.T. the Exceptional Trajectories In this paper, Robin proposes a way for this knowledge to be democratized. “It’s about trying to translate the film grammar of directors, like the artistic point of view of cinematography,” he tells us. “When you shoot a scene, an amateur won’t do the same things as a professional director because they’re experts and know the film grammar. They know with a certain camera trajectory what feelings the audience will perceive.” The idea of this work is to generate camera trajectories based on simple textual prompts. Rendering 3D scenes manually in tools like Blender or Unity can be a painstaking process. Here, users can say, ‘I want a camera trajectory moving to the right,’ and create a professionallooking shot that they can then rectify, modify, or leave as-is. The ultimate goal is to make camera trajectory accessible to everyone, helping general users create compelling 3D scenes without needing years of experience or training. A common concern when translating artistic processes into algorithms is the fear of losing creativity. Good cinema thrives on breaking the rules and pushing boundaries. While the current goal is not to break new ground in cinematography, Robin says the system may occasionally produce unexpected results. “Since our approach is new and imperfect in the way of copying every director trajectory, maybe some outlier could create a new camera trajectory that would have never been seen before,” he points out. “Then we could say, okay, we’ve created a new cinema movement!”

RkJQdWJsaXNoZXIy NTc3NzU=