The purpose of this study is to analyze how the problems caused by overtourism affect the quality of life of Jeju residents and their perceptions of the overtourism phenomenon by exploring related factors for future policy implications. In the research model, each independent factor related to tourists affects the quality of life of residents, and the mediation variable (QoL) ultimately agrees with overtourism. This study uses Partial Least Squares-Structural Equation Modeling (PLS-SEM), which is less influenced by the sample size. The research is based on 360 questionnaires. The test results showed that cultural factors affected the QoL statistically at 1% significance level, and economic factors were significant at 5%. The quality of life variable affects the agreement of overtourism (p-value 1% significance level). An indirect effect analysis on whether each independent factor affects the overtourism factor through the parameter of the QoL of the residents showed that the cultural factor at 5% level statistically affected it, and economic factors were significant at 10%. In conclusion, we recommend implementing both economic and cultural factors to reduce the negative perception of overtourism for the policy planning. Further research in multiple aspects should be continued to overcome the vulnerability of the Island destination tourism.