Dongjun Lee

+82 10-3256-2868 dgjun32[at]kaist.ac.kr

I am M.S student at Graduate school of AI, KAIST, co-advised by Prof. Kimin Lee and Prof. Jinwoo Shin.

My research goal is to make AI agent capable of sequential decision making based on deliberate reasoning. For this goal, I am interested in aligning LLMs / VLMs to possess behaviors necessary for decision making (e.g., look ahead, backtracking, exploration) . I am also interested in multi-objective alignment of large-scale models. Currently, I am focusing on developing generalist agent for digital environment such as Web browser and Operating systems.

Education

Korea Advanced Institute of Science and Technology

M.S in Artificial intelligence
Mar. 2024 - Present

Korea University

B.S in Statistics & Artificial intelligence
Mar. 2018 - Feb. 2024

Research & Working experiences

Graduate School of AI, KAIST

M.S student
  • Advisor: Prof. Kimin Lee & Prof. Jinwoo Shin
  • Research topic: Embodied Agent, Large Language Models, Reinforcement Learning
Aug 2023 - Ongoing

NAVER Corp

Research intern
  • Research topic: Retrieval augmented test-time adaptation of vision-language model using multi-modal external knowledge.
Jul 2023 - Aug 2023

Machine Learning and Vision Lab, Korea University

Research intern
  • Advisor: Prof. Hyunwoo J.Kim
  • Research Topic: Vision-Language Models
Feb 2022 - Jun 2023

Publications & Patents

Publications

  • [C1]Read-only prompt optimization for Vision-Language Few-shot Learning
    Dongjun Lee, Seokwon Song, Jihee Suh, Joonmyeong Choi, Sanghyeok Lee, and Hyunwoo J. Kim
    IEEE/CVF International Conference on Computer Vision, 2023
    tl;dr : Parameter efficient vision-language model adaptation method with improved label & domain generalization.
    [arXiv] [Github]

Patents

  • Method and Appratus for Read-only Prompt Learning Apr, 2023 H.W. Kim, J.Y. Park, D.J. Lee, S.W. Song, J.H. Suh, J.M. Choi, S.H. Lee, Korea Patent 10-2023-0049563 (2023)

Awards & Honors

  • Donggyo Talent Award, Surim Foundation (2023)
  • Ilju Academy and Culture Foundation Scholarship (2019-2023)
  • Semester High Honor, Korea University (2018, 2019, 2022)
  • Semester Exellence Scholarship, Korea University (Fall, 2018)