Computer Vision News - December 2021

43 Chen Chen Learning with unlabelled data Weconsiderexploitingthevalueofunlabelled data, which is cheap and often widely available . We develop a novel adversarial data augmentation (DA) method with realistic image transformations (adv bias, adv chain) to augment labeled and unlabelled images for more effective consistency regularization. This adversarial DA can be applied as a plug-in module in both supervised and semi-supervised medical image segmentation frameworks. We further propose an unsupervised style transfer method with a cascaded U-net for unsupervised domain adaptation , where there is a distributional gap between source domain images (labeled) and target domain images (unlabelled). We first train an image- style translation network by utilizing a set of labeled bSSFP MR images (source domain) and unlabelled LGE MR images (target domain). We then employ the trained network to translate labeled bSSFP images to be LGE-like images, which are then used to train an LGE segmentation network. Our approach does not require labeled LGE images for training, yet it can surprisingly achieve high segmentation accuracy on LGE images, ranking 1st in the public multi-sequence cardiac MR segmentation challenge [More] . Learning from limited, single-domain data for improved cross-domain performance In the worst scenario where we only have access to limited labeled data from a single domain for training, the model can easily fail to predict images from unseen test sets due to the domain shift problem (see Figure above). A natural solution is data augmentation, which simulates the domain shifts at training. We first design a general training and testing pipelinewith datanormalizationandaugmentation to improve cardiac image segmentation performance across various unseen domains. We further propose a latent space data augmentation method with a cooperative training framework to enhance model robustness against unseen domain shifts and imaging artifacts. By performing random/ targeted code masking in the latent space, a set of challenging examples are generated to strengthen the network capacity. This latent-space masking-based data augmentation method is effective and practical, as it does not require domain knowledge and expertise to design a particular image augmentation/corruption function. Acknowledgment: The research was supported by the SmartHeart EPSRC Programme Grant (EP/P001009/1).