The bubble oscillator is a highly nonlinear system, which makes it difficult to generate a comprehensive understanding of its oscillatory behavior. One method used to investigate such complex dynamical systems is the bifurcation analysis. Numerous investigations have employed the method of bifurcation diagrams to study the effect of different control parameters on the bubble behavior. These studies, however, focused mainly on investigating the subharmonic (SH) and chaotic oscillations of the bubbles. Super-harmonic (SuH) and ultra-harmonic (UH) bubble oscillations remain under-investigated. One reason is that the conventional method used for generating bifurcation diagrams cannot reliably identify features that are responsible for the identification of SuH and UH oscillations. Additionally, the conventional method cannot distinguish between the UHs and SHs. We introduce a simple procedure to address this shortcoming. In this method, the maxima of the bubble oscillatory response were selected and plotted alongside the traditional bifurcation points for the corresponding control parameter. Results show that depending on the control parameters the conventional method or the method of maxima may miss intricate details of the oscillations. In order to have a comprehensive knowledge on the rich dynamics of the system, the two methods should be employed side by side. Through plotting the two bifurcation structures in tandem, the oscillatory behavior of the bubble was analyzed with more detail, and stable SuH and UH bubble oscillations were investigated. Based on this new analysis, the conditions for the generation and amplification of UH and SuH regimes are discussed.