Byung-Kuk Seo, Ph.D.

last update Apr 2024

Current Appointment

I earned my Ph.D. in Electronics and Computer Engineering at Hanyang University under the supervision of Prof. Jong-Il Park. During my Ph.D., I had the good fortune to collaborate with Dr. Slobodan Ilic in Chair for Computer Aided Medical Procedures & Augmented Reality (CAMP) at Technical University of Munich (TUM). Before joining the ETRI, I was a postdoctoral research fellow in Dept. of Virtual and Augmented Reality at Fraunhofer Institute for Computer Graphics (IGD) under the guidance of Dr. Harald Wuest.

Contact (Linkedin)

  • byungkuk.seo@etri.re.kr, peter.byungkuk.seo@gmail.com
  • Building 7-601, Electronics and Telecommunications Research Institute (ETRI)
    218 Gajeong-ro, Yuseong-gu, Daejeon 34129, South Korea

Publication

Research Activity

My research interests are mainly 3D computer vision for augmented reality, including 6D pose estimation/localization and mapping, low-level feature description and matching, and camera calibration. I am also interested in augmented/virtual/mixed/extended reality in industrial, medical, educational, art, or game applications.

To date, I have been collaborating with outstanding researchers: Prof. Kangsoo Kim (University of Calgary, Canada), Prof. Jong-Il Park (Hanyang University/Seerslab, South Korea), Dr. Jungsik Park (Seerslab, South Korea), Dr. Harald Wuest (Visometry GmbH/Fraunhofer IGD, Germany), Dr. Slobodan Ilic (Siemens AG Corporate Technology/Technical University of Munich (TUM), Germany), Dr. Stefan Hinterstoissor (Intrinsic, Germany), Prof. Hideaki Uchiyama (NARA Institute of Science and Technology, Japan), Dr. Moon-Hyun Lee (LG Electronics, South Korea), Prof. Hanhoon Park (Pukyong National University, South Korea)

In addition, I have been serving as:
  • Committee (Demo Co-Chairs): International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE) (2020)
  • Review Board Member: MDPI Sensors (2020-)
  • Reviewer (journal): IEEE Transactions on Visualization and Computer Graphics (TVCG) (2021, 2022), IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) (2013, 2022, 2023), Multimedia Tools and Applications (MTAP) (2012–2022), MDPI Sensors (2019–2024)/Applied Sciences (2019, 2020), IPSJ Transactions on Computer Vision and Applications (TCVA) (2016), Journal of Virtual Reality and Broadcasting (JVRB) (2013)
  • Reviewer (conference): IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2012–2024), IEEE Virtual Reality (VR) (2013, 2014, 2021, 2023), ACM Virtual Reality Software and Technology (VRST) (2022, 2023), HCI International (HCII) (2022), IAPR Asian Conference on Pattern Recognition (ACPR) (2013), Korea Computer Congress (KCC) (2018, 2019, 2022)
  • External Advisory Reviewer (thesis): Ph.D. Dissertation Proposal (by Ulka Chandini Pendit, Universiti Utara Malaysia, Malaysia) (2013)

WIP

Research Project (2016-current)

  • Development of Video Synthesis and Editing Technology for Linking Neural Assets-Based Video Production Pipeline
    Granted by Ministry of Culture, Sports and Tourism, South Korea (Apr 2024–Dec 2026)
  • Technology development of creation, manipulation and augmentation for XR in the real-world environment
    Granted by Ministry of Science and ICT, South Korea (Apr 2021–Dec 2024)
    • (Completed) Satellite: A Survey of Physically Plausible Virtual Interactions in XR
      Collaborated with Prof. Kangsoo Kim, University of Calgary, Canada
      Granted by Ministry of Science and ICT, South Korea (Jun 2022–Oct 2022)
  • (Completed) Technology development for 3D manipulation of a real object in MR on untact e-commerce
    Granted by Ministry of Science and ICT, South Korea (Jul 2020–Dec 2021)
  • (Completed) Development of core technology for real-time image composition in unstructured in-outdoor environment
    Granted by Ministry of Science and ICT, South Korea (Aug 2017–Dec 2020)

Publication (google scholar | researchgate)

Journal Article
A new perspective on enriching augmented reality experiences: Interacting with the real world
Byung-Kuk Seo, Jungsik Park, and Jong-Il Park
PRESENCE: Virtual and Augmented Reality, Jan 2022
paper (author version)
User experience design for a smart-mirror-based personalized training system
Hye Sun Park, Gun A. Lee, Byung-Kuk Seo, and Mark Billinghurst
Multimedia Tools and Applications (MTAP), Aug 2021
paper
A framework for real-time 3D freeform manipulation of facial video
Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
Applied Sciences, Nov 2019
paper (open access), video
Binocular mobile augmented reality based on stereo camera tracking
Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
Journal of Real-Time Image Processing (JRTIP), Sep 2017
paper (open access)
Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds
Byung-Kuk Seo, Hanhoon Park, Jong-Il Park, Stefan Hinterstoisser, and Slobodan Ilic
IEEE Transactions on Visualization and Computer Graphics (TVCG), Jan 2014
paper (author version), video
(Now integrated into OpenCV contrib modules (thanks to contributors!))
Real-time visual tracking of less textured three-dimensional objects on mobile platforms
Byung-Kuk Seo, Jungsik Park, Hanhoon Park, and Jong-Il Park
Optical Engineering, Jan 2013
paper, video
Subjective evaluation on visual perceptibility of embedding complementary patterns for nonintrusive projection-based augmented reality
Hanhoon Park, Byung-Kuk Seo, and Jong-Il Park
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), May 2010
paper
Automatic confidence adjustment of visual cues in model-based camera tracking
Hanhoon Park, Jihyun Oh, Byung-Kuk Seo, and Jong-Il Park
Computer Animation and Virtual Worlds (CAVW), Mar/Apr 2010
paper
(Extended work of the selected paper (Best Paper Award) from VRCAI 2018)
Optimal illumination for discriminating objects with different spectra
Moon-Hyun Lee, Dong-Kyun Seo, Byung-Kuk Seo, and Jong-Il Park
Optics Letters, Sep 2009
paper
Simultaneous geometric and radiometric adaptation to dynamic surface with a mobile projector-camera system
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Jong-Il Park, Moon-Sik Jeong, Tae-Suh Park, Yongbeom Lee, and Sang-Ryong Kim
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Jan 2008
paper

Conference Paper
Exploring industrial uses of virtually altering the physical world
Yifan Li, Byung-Kuk Seo, and Kangsoo Kim
IEEE Conference on Virtual Reality and 3D User Interfaces 2023 Workshops (VRW), Mar 2023
paper
Exploring the value of shared experience in augmented reality games
Hye Sun Park, Byung-Kuk Seo, Gun A. Lee, and Mark Billinghurst
International Conference on Human-Computer Interaction (HCII), Jul 2020
paper
A direct method for robust model-based 3D object tracking from a monocular RGB image
Byung-Kuk Seo and Harald Wuest
European Conference on Computer Vision 2016 Workshops (ECCVW), Oct 2016
paper (author version), video
(Best Paper Award with prize money, Selected Readings 2016 in Fraunhofer IGD)
3D trajectory reconstruction under refraction at a cylindrical surface
Byung-Kuk Seo, Jungsik Park, and Jong-Il Park
IEEE International Conference on Image Processing (ICIP), Sep 2015
paper
Semi-automatic interactive modeling for model-based camera tracking
Eun Joo Rhee, Kangsoo Kim, Byung-Kuk Seo, and Jong-Il Park
IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC), Sep 2012
paper
3-D visual tracking for mobile augmented reality applications
Byung-Kuk Seo, Jungsik Park, and Jong-Il Park
IEEE International Conference on Multimedia and Expo (ICME), Jul 2011
paper, video
Camera tracking using partially modeled 3-D objects with scene textures
Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
IEEE International Symposium on Virtual Reality Innovation (ISVRI), Mar 2011
paper, video
A tracking framework for augmented reality tours on cultural heritage sites
Byung-Kuk Seo, Kangsoo Kim, Jungsik Park, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), Dec 2010
paper (author version)
Augmented reality-based on-site tour guide: A study in Gyeongbokgung
Byung-Kuk Seo, Kangsoo Kim, and Jong-Il Park
Asian Conference on Computer Vision 2010 Workshops (ACCVW), Nov 2010
paper (author version), video
Robust hand detection for augmented reality interface
Junyeong Choi, Byung-Kuk Seo, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI), Dec 2009
paper
Object-adaptive tracking for AR guidance system
Hanhoon Park, Jihyun Oh, Byung-kuk Seo, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), Dec 2008
paper
(Best Paper Award)
One-handed interaction with augmented virtual objects on mobile devices
Byung-Kuk Seo, Junyeong Choi, Jae-Hyek Han, Hanhoon Park, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), Dec 2008
paper (author version)
Direct-projected augmented reality for robot-assisted surgery
Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, Jong-Il Park, and Young Soo Kim
International Symposium on Robotics (ISR), Oct 2008
paper
A nonintrusive method for generating all-focused projection
Hanhoon Park, Byung-Kuk Seo, and Jong-Il Park
IEEE International Conference on Image Processing (ICIP), Oct 2008
paper
Projection-based diminished reality system
Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, and Jong-Il Park
International Symposium on Ubiquitous Virtual Reality (ISUVR), Jul 2008
paper
Direct-projected AR based interactive user interface for medical surgery
Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, and Jong-Il Park
International Conference on Artificial Reality and Telexistence (ICAT), Nov 2007
paper
Portable projection-based AR system
Ji-Hyun Oh, Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, and Jong-Il Park
International Symposium on Visual Computing (ISVC), Nov 2007
paper
Content adaptive embedding of complementary patterns for nonintrusive direct-projected augmented reality
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Yoonjong Jin, and Jong-Il Park
International Conference on Human-Computer Interaction (HCII), Jul 2007
paper
Radiometrically-compensated projection onto non-Lambertian surface using multiple overlapping projectors
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Hong-Chang Shin, and Jong-Il Park
Pacific-Rim Symposium on Image and Video Technology (PSIVT), Dec 2006
paper
Undistorted projection onto dynamic surface
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, and Jong-Il Park
Pacific-Rim Symposium on Image and Video Technology (PSIVT), Dec 2006
paper

(up to two-page poster, abstract, demo)

  • Robust 3D object tracking using an elaborate motion model
    Byung-Kuk Seo and Harald Wuest
    IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Sep 2016
    paper (author version), video
    (Best Poster Paper Runner Up Award)
  • Interactive deformation of real objects
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Sep 2014
    paper, video
  • RGB-D camera-based hand shape recognition for human-robot interaction
    Junyeong Choi, Byung-Kuk Seo, Daeseon Lee, Hanhoon Park, and Jong‐Il Park
    IEEE International Symposium on Robotics (ISR), Sep 2013
    paper
  • stAR: Visualizing constellations with star retrieval
    Byung-Kuk Seo, Hideaki Uchiyama, and Jong-Il Park
    ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia), Dec 2011
    paper, video
  • Augmented reality tour system for immersive experience of cultural heritage
    Kangsoo Kim, Byung-Kuk Seo, Jae-Hyek Han, and Jong-Il Park
    ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI), Dec 2009
    paper
  • Virtual-pen for computer aided surgery
    Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, Jong-Il Park, and Young Soo Kim
    International Congress and Exhibition on Computer Assisted Radiology and Surgery (CARS), Jun 2007
    paper

(presentation, others)

  • Interactive virtual manipulation of a 3D real object using visual tracking
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    International Workshop on Advanced Image Technology (IWAIT), Jan 2014
  • Stereo endoscope-based 3D surface reconstruction for image-guided system
    Junyeong Choi, Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    Asian Conference on Computer Aided Surgery (ACCAS), Sep 2013
  • A practical solution for natural hand interaction in surgical environments
    Daeseon Lee, Junyeong Choi, Byung-Kuk Seo, and Jong‐Il Park
    Asian Conference on Computer Aided Surgery (ACCAS), Sep 2013
  • Interactive augmented reality system using a non-contact tactile interface
    Daeseon Lee, Junyeong Choi, Byung-Kuk Seo, and Jong‐Il Park
    International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), Jun 2013
  • Fast stereo image rectification using mobile GPU
    Jungsik Park, Junyeong Choi, Byung-Kuk Seo, and Jong‐Il Park
    International Conference on Digital Information Processing and Communications (ICDIPC), Jun 2013
  • Model-based tracking in highly cluttered backgrounds
    Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    Korea-Japan Workshop on Mixed Reality (KJMR), Apr 2013
    (Best Presentation Award)
  • Tolerance analysis of model-based camera tracking by modeling errors
    Eun Joo Rhee, Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Jan 2013
  • A framework of augmented reality on 3-D mobile display using stereo camera tracking
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    International Workshop on Advanced Image Technology (IWAIT), Jan 2013
  • 3-D model-based tracking on a mobile phone
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Workshop on Mixed Reality (KJMR), Apr 2011
  • Optimal illumination spectrum for endoscope
    Moon-Hyun Lee, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Feb 2011
  • Optimal illumination for discriminating objects with different spectra
    Moon-Hyun Lee, Dong-Kyun Seo, Byung-Kuk Seo, and Jong-Il Park
    Joint Workshop between Hanyang University and Shanghai Jiao Tong University, Aug 2010
  • Model-based tracking in partially known scenes
    Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    Korea-Japan Workshop on Mixed Reality (KJMR), Apr 2010
  • MeDAR: Medical direct-projected augmented reality
    Byung-Kuk Seo, Moon-Hyun Lee, and Jong-Il Park
    Asian Conference on Computer Aided Surgery (ACCAS), Jul 2009
    (Best Poster Presentation Award)
  • Change-of-light compensation for intelligent image projection
    Moon-Hyun Lee, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Feb 2009
  • Natural interaction with virtual pet on your palm
    Junyeong Choi, Jae-Hyek Han, Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    International Workshop on Advanced Image Technology (IWAIT), Jan 2009
  • Implementation of direct-projected augmented reality system on wet surface
    Moon-Hyun Lee, Hanhoon Park, Byung-Kuk Seo, Hong-Chang Shin, and Jong-Il Park
    World Congress on Medical Physics and Biomedical Engineering (WC), 2006

(papers in Korean)

  • 14 journal articles / 22 conference papers
    (details are not listed here)

Thesis

  • Model-based visual tracking of textureless 3D rigid objects
    Ph.D. dissertation, Feb 2014
    Committee: Prof. Jechang Jeong (chair), Prof. Euee S. Jang, Prof. Jongwoo Lim, Dr. Slobodan Ilic, and Prof. Jong-Il Park (supervisor)
    (Best Doctoral Dissertation Award in Engineering)
  • Projection-based interactive augmented reality system
    M.Sc. thesis, Feb 2008
    Committee: Prof. Jechang Jeong (chair), Prof. Whoi-Yul Kim, and Prof. Jong-Il Park (supervisor)

Patent

  • Physical phenomena simulation method for expressing the physical phenomena in mixed reality, and mixed reality apparatus that performs the method
    10-2535404 B1; applied in South Korea, May 2023
  • Method for providing augmented reality based on multi-user and apparatus using the same
    10-2316714 B1; issued in South Korea, Oct 2021
  • Method for providing augmented reality contents
    10-2074370 B1; issued in South Korea, Jan 2020
  • Method for obtaining full reflectance spectrum of a surface and apparatus therefor
    10-1958493 B1; issued in South Korea, Mar 2019
  • Wearable display device having a sliding structure
    10-1952974 B1; issued in South Korea, Feb 2019
  • Wearable display device
    10-1952973 B1; issued in South Korea, Feb 2019
  • Wearable display device having a detection function
    10-1952972 B1; issued in South Korea, Feb 2019
  • Apparatus and method for providing haptic on virtual video
    10-1906633 B1; issued in South Korea, Oct 2018
  • Apparatus and method for providing haptic which cooperates with display apparatus
    10-1906634 B1; issued in South Korea, Oct 2018
  • Wearable display device using augmented reality
    10-1891837 B1; issued in South Korea, Aug 2018
  • Wrist-wearable display apparatus and method for controlling the same
    US 9,971,381 B2; issued in United States, May 2018
  • Method for obtaining full reflectance spectrum of a surface and apparatus therefor
    US 9,778,109 B2; issued in United States, Oct 2017
  • Wearable display device having a sliding structure
    US 9,726,895 B2; issued in United States, Aug 2017
  • Wearable display device having a detection function
    US 9,568,735 B2; issued in United States, Feb 2017
  • Wearable display device
    US 9,465,216 B2; issued in United States, Oct 2016
  • Wearable display device having a sliding structure
    US 9,329,391 B2; issued in United States, May 2016
  • Apparatus and method for providing tactile sensation for virtual image
    US 9,323,330 B2; issued in United States, Apr 2016
  • Apparatus and method for providing tactile sensation in cooperation with display device
    US 9,317,121 B2; issued in United States, Apr 2016
  • Wearable display apparatus for wrist and method for controlling the same
    10-1489620 B1; issued in South Korea, Jan 2015
  • Markerless hand-based interface for wearable display
    10-1476503 B1; issued in South Korea, Dec 2014
  • Apparatus and method for providing haptic which cooperates with display apparatus
    10-1428880 B1; issued in South Korea, Aug 2014
  • Wearable display device
    10-1396005 B1; issued in South Korea, May 2014
  • Wearable display device having sensing function
    10-1375868 B1; issued in South Korea, Mar 2014
  • Apparatus and method for providing haptic on virtual video
    10-1370090 B1; issued in South Korea, Feb 2014
  • Wearable display device having a sliding structure
    10-1321157 B1; issued in South Korea, Oct 2013
  • System and method for providing tactile in augmented reality based marker
    10-1194957 B1; issued in South Korea, Oct 2012
  • Apparatus and method for providing changed surroundings information-compliant virtual contents of 3-dimension
    10-1168116 B1; issued in South Korea, Jul 2012
  • Mobile augmented reality system for interaction with 3D virtual objects and method thereof
    10-0980202 B1; issued in South Korea, Aug 2010
  • Medical image providing system and method of providing a medical image using the same
    10-0877114 B1; issued in South Korea, Dec 2008