As a member of the fatty acids transporter family, the heart fatty acid binding proteins (HFABPs) are responsible for many important biological activities. The binding mechanism of fatty acid with FABP is critical to the understanding of FABP functions. The uncovering of binding-relevant intermediate states and interactions would greatly increase our knowledge of the binding process. In this work, all-atom molecular dynamics (MD) simulations were performed to characterize the structural properties of nativelike intermediate states. Based on multiple 6 μs MD simulations and Markov state model (MSM) analysis, several “open” intermediate states were observed. The transition rates between these states and the native closed state are in good agreement with the experimental measurements, which indicates that these intermediate states are binding relevant. As a common property in the open states, the partially unfolded α2 helix generates a larger portal and provides the driving force to facilitate ligand binding. On the other side, there are two kinds of open states for the ligand-binding HFABP: one has the partially unfolded α2 helix, and the other has the looser β-barrel with disjointing βD-βE strands. Our results provide atomic-level descriptions of the binding-relevant intermediate states and could improve our understanding of the binding mechanism.