Orca: A distributed serving system for {Transformer-Based} generative models GI Yu, JS Jeong, GW Kim, S Kim, BG Chun 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI …, 2022 | 229 | 2022 |
Pado: A data processing engine for harnessing transient resources in datacenters Y Yang, GW Kim, WW Song, Y Lee, A Chung, Z Qian, B Cho, BG Chun Proceedings of the Twelfth European Conference on Computer Systems, 575-588, 2017 | 63 | 2017 |
Apache nemo: A framework for building distributed dataflow optimization policies Y Yang, J Eo, GW Kim, JY Kim, S Lee, J Seo, WW Song, BG Chun 2019 USENIX Annual Technical Conference (USENIX ATC 19), 177-190, 2019 | 12 | 2019 |
Terra: Imperative-symbolic co-execution of imperative deep learning programs T Kim, E Jeong, GW Kim, Y Koo, S Kim, G Yu, BG Chun Advances in Neural Information Processing Systems 34, 1468-1480, 2021 | 5 | 2021 |
Dynamic batching for inference system for transformer-based generation tasks YU Gyeongin, G Kim, JS Jeong, S Kim, BG Chun US Patent 11,442,775, 2022 | 4 | 2022 |
Lovelock: Towards Smart NIC-hosted Clusters SJ Park, R Govindan, K Shen, D Culler, F Özcan, GW Kim, H Levy arXiv preprint arXiv:2309.12665, 2023 | 2 | 2023 |
Dynamic batching for inference system for transformer-based generation tasks YU Gyeongin, G Kim, JS Jeong, S Kim, BG Chun US Patent App. 18/453,298, 2024 | | 2024 |
Selective batching for inference system for transformer-based generation tasks YU Gyeongin, G Kim, JS Jeong, S Kim, BG Chun US Patent 11,934,930, 2024 | | 2024 |
Selective batching for inference system for transformer-based generation tasks YU Gyeongin, G Kim, JS Jeong, S Kim, BG Chun US Patent 11,922,282, 2024 | | 2024 |
Dynamic batching for inference system for transformer-based generation tasks YU Gyeongin, G Kim, JS Jeong, S Kim, BG Chun US Patent 11,836,520, 2023 | | 2023 |
Method and apparatus for executing deep learning programs T bum Kim, BG Chun, GW Kim, YM Koo, GI YU, EJ Jeong, SH Kim US Patent App. 17/954,345, 2023 | | 2023 |
Selective batching for inference system for transformer-based generation tasks YU Gyeongin, G Kim, JS Jeong, S Kim, BG Chun US Patent 11,514,370, 2022 | | 2022 |