In this paper, we propose a novel concept of cross-learning, in order to improve SAR images by learning from the camera images. We use a multi-level abstraction approach to materialise knowledge transfer between the two modalities. We also compare the performance of other possible approaches. We provide experimental results on real data to validate the proposed concept.