The brain tumor can be categorized into two groups: benign and malignant tumor. The brain tumor management process is contingent on the physician’s experience, knowledge, and efficient algorithms. Initial exposure of tumor and treatment plan leads to enhanced eminence of life and improved life expectation in these patients. Clinical trainings have shown that discussing many primary brain tumors is stimulating task due in part to the nonexistence of safe and effective compounds that cross the blood–brain barrier. Usually, brain tumor can be categorized as additional in hundred categories built on position and development of the tumor. This exploration article proposed a novel approach to ascertain the brain tumor and diagnose the disease with less computational time. Convolutional neural network for classification problematic and faster region-based convolutional neural network for segmentation problem with abridged number of computational time with developed accuracy level. Our research results managed to accomplish that the innovative system is capable of segmenting the tumor image using faster R-CNN to produce the output with efficient accurateness.