In this paper we propose a joint Point Process and CNN based method for object detection in satellite imagery. The Point Process allows building a lightweight interaction model, while the CNN allows to efficiently extract meaningful information from the image in a context where interaction priors can complement the limited visual information. More specifically, we present matching parameter estimation and result scoring procedures, that allow to take into account object interaction. The method provides good results on benchmark data, along with a degree of interpretability of the output. The code will be available at github.com/Ayana-Inria/