Logprompt: Prompt engineering towards zero-shot and interpretable log analysis

Y Liu, S Tao, W Meng, F Yao, X Zhao… - Proceedings of the 2024 …, 2024 - dl.acm.org
Proceedings of the 2024 IEEE/ACM 46th International Conference on Software …, 2024dl.acm.org
Automated log analysis plays a crucial role in software maintenance as it allows for efficient
identification and resolution of issues. However, traditional methods employed in log
analysis heavily rely on extensive historical data for training purposes and lack rationales for
its predictions. The performance of these traditional methods significantly deteriorates when
in-domain logs for training are limited and unseen log data are the majority, particularly in
rapidly changing online environments. Additionally, the lack of rationales hampers the …
Automated log analysis plays a crucial role in software maintenance as it allows for efficient identification and resolution of issues. However, traditional methods employed in log analysis heavily rely on extensive historical data for training purposes and lack rationales for its predictions. The performance of these traditional methods significantly deteriorates when in-domain logs for training are limited and unseen log data are the majority, particularly in rapidly changing online environments. Additionally, the lack of rationales hampers the interpretability of analysis results and impacts analysts' subsequent decision-making processes. To address these challenges, we proposes LogPrompt, an novel approach that leverages large language models (LLMs) and advanced prompting techniques to achieve performance improvements in zero-shot scenarios (i.e., no in-domain training). Moreover, LogPrompt has garnered positive evaluations from experienced practitioners in its log interpretation ability. Code available at https://github.com/lunyiliu/LogPrompt.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果