ECCV 2022 - Wednesday

recent papers have been on future prediction in its many representations – pixels, bird’s -eye view, and coordinates. She hopes they will have a submission for CVPR 2023 on trajectory forecasting in the coordinate space . “ We’re also working on trying to segment and detect corner cases where an unknown object is on the road, ” she tells us. “ On top of this, we’re trying to connect it to robotics to use these world models in action. How can we learn to act based on the predictions of the world model? For that, you need action condition prediction. Given the current state and the action to perform, you predict a different future. For example, if you go straight, the future looks different from if you turn left. We’re trying to predict these conditional futures based on the input action. ” When real data is available, the team uses it, but when they cannot find real data and need actions in a particular form, they use a simulator like CARLA. For future prediction, they use nuScenes , and for trajectory prediction, Argoverse and the INTERACTION data set. 25 Adil Kaan Akan