Determining the variety of wheat is important to know the physical and chemical properties which may be useful in grain processing. It also affects the price of wheat in the food industry. In this study, a Convolutional Neural Network (CNN)-based model was proposed to determine wheat varieties. Images of four different piles of wheat, two of which were the bread and the remaining durum wheat, were taken and image pre-processing techniques were applied. Small-sized images were cropped from high-resolution images, followed by data augmentation. Then, deep features were extracted from the obtained images using pre-trained seven different CNN models (AlexNet, ResNet18, ResNet50, ResNet101, Inceptionv3, DenseNet201, and Inceptionresnetv2). Support Vector Machines (SVM) classifier was used to classify deep features. The classification accuracies obtained by classification with various kernel functions such as Linear, Quadratic, Cubic and Gaussian were compared. The highest wheat classification accuracy was achieved with the deep features extracted with the Densenet201 model. In the classification made with the Cubic kernel function of SVM, the accuracy value was 98.1%.