Automatic modulation recognition (AMR) has become increasingly important in the field of signal processing, especially with the advancements of intelligent communication systems. Deep Learning (DL) technologies have been incorporated into the AMR field and they have shown outstanding performances against conventional AMR methods. The robustness of DL-based AMR methods under varying noise regimes is one of major concerns for the widespread utilization of this technology. Furthermore, most existing works have neglected the contributions of hand-crafted features (HCFs) in boosting the classification performances of DL-based AMR methods. In order to address the aforementioned technical challenges, a novel and robust DL-AMR method is proposed by leveraging the benefits of both contextual features (CFs) and HCFs for a specific range of signal-to-noise ratio (SNR). A novel feature selection algorithm is also proposed to search for the optimal sets of HCFs in order to reduce the dimensions of feature vectors without losing any important and relevant features. Simulation studies are performed to investigate the feasibility of proposed method in classifying 11 types of modulation schemes. Extensive performance analyses revealed the superiority of proposed method over baseline method in terms of the classification performance as well as the excellent capability of proposed feature selection algorithm in determining an optimal subset of HCFs.