Byung-Kuk Seo, Ph.D.

last update May 2021

Current Appointment

I earned my Ph.D. in Electronics and Computer Engineering at Hanyang University under the supervision of Prof. Jong-Il Park. During my Ph.D., I had the good fortune to collaborate with Dr. Slobodan Ilic in Chair for Computer Aided Medical Procedures & Augmented Reality (CAMP) at Technical University of Munich (TUM). Before joining the ETRI, I was a postdoc in Mixed Reality Lab. at Hanyang University under the guidance of Prof. Jong-Il Park. And then, I moved to Dept. of Virtual and Augmented Reality at Fraunhofer Institute for Computer Graphics (IGD) and worked as a postdoctoral research fellow under the guidance of Dr. Harald Wuest.

Contact (Linkedin)

  • byungkuk.seo@etri.re.kr, peter.byungkuk.seo@gmail.com
  • Building 7-601, Electronics and Telecommunications Research Institute (ETRI)
    218 Gajeong-ro, Yuseong-gu, Daejeon 34129, South Korea

Research Activity

My research interests are mainly 3D computer vision for augmented reality, including 6D pose estimation/localization and mapping, low level feature description and matching, and camera calibration. I am also interested in augmented reality in industrial, medical, educational, art, or game applications.

To date, I have been collaborating with outstanding researchers: Dr. Jungsik Park (Atom&Bit Co., South Korea), Dr. Harald Wuest (Visometry GmbH/Fraunhofer IGD, Germany), Dr. Slobodan Ilic (Siemens AG Corporate Technology/Technical University of Munich (TUM), Germany), Dr. Stefan Hinterstoissor (Google X, Germany), Prof. Hideaki Uchiyama (Kyushu University, Japan), Dr. Kangsoo Kim (University of Delaware, US), Dr. Moon-Hyun Lee (LG Electronics, South Korea), Prof. Hanhoon Park (Pukyong National University, South Korea), Prof. Jong-Il Park (Hanyang University/Atom&Bit Co., South Korea)

In addition, I have been serving as:
  • Committee (Demo Co-Chairs): International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments (ICAT-EGVE) (2020)
  • Review Board Member: MDPI Sensors (2020-2022)
  • Reviewer (journal): IEEE Transactions on Visualization and Computer Graphics (TVCG) (2021), Multimedia Tools and Applications (MTAP) (2012–2021), MDPI Sensors (2019, 2020)/Applied Sciences (2019, 2020)/Electronics (2021)/Machines (2021)/Future Internet (2020)/Remote Sensing (2019)/Sustainability (2019), Journal of Marine Science and Engineering (JMSE) (2019), IPSJ Transactions on Computer Vision and Applications (TCVA) (2016), IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) (2013), Journal of Virtual Reality and Broadcasting (JVRB) (2013)
  • Reviewer (conference): IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2012–2020), IEEE Virtual Reality (VR) (2013, 2014, 2021), IAPR Asian Conference on Pattern Recognition (ACPR) (2013), Korea Computer Congress (KCC) (2018, 2019)
  • External Advisory Reviewer (thesis): Ph.D. Dissertation Proposal (by Ulka Chandini Pendit, Universiti Utara Malaysia, Malaysia) (2013)

WIP

Research Project

  • Technology development of creation, manipulation and augmentation for XR in the real-world environment
    Granted by Ministry of Science and ICT, South Korea (Apr 2021–Dec 2024)
  • Technology development for 3D manipulation of a real object in MR on untact e-commerce
    Granted by Ministry of Science and ICT, South Korea (Jul 2020–Dec 2021)

Topics on Paper

  • Recovering 6D object poses
  • Amended semi-direct sparse visual odometry for AR (technical report)
  • Novel approach for the next-level of augmented reality (under review)

Publication (google scholar | researchgate)

Journal Article

User experience design for a smart-mirror-based personalized training system
Hye Sun Park, Gun A. Lee, Byung-Kuk Seo, and Mark Billinghurst
Multimedia Tools and Applications (MTAP), 2020 (online first)
paper
A framework for real-time 3D freeform manipulation of facial video
Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
Applied Sciences, Nov 2019
paper (open access), video
Binocular mobile augmented reality based on stereo camera tracking
Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
Journal of Real-Time Image Processing (JRTIP), Sep 2017
paper (open access)
Subjective evaluation on perceptual tracking errors from modeling errors in model-based tracking
Eun Joo Rhee, Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
IEIE Transactions on Smart Processing and Computing (TSPC), Dec 2015
paper
Optimal local searching for fast and robust textureless 3D object tracking in highly cluttered backgrounds
Byung-Kuk Seo, Hanhoon Park, Jong-Il Park, Stefan Hinterstoisser, and Slobodan Ilic
IEEE Transactions on Visualization and Computer Graphics (TVCG), Jan 2014
paper (author version), video
Real-time visual tracking of less textured three-dimensional objects on mobile platforms
Byung-Kuk Seo, Jungsik Park, Hanhoon Park, and Jong-Il Park
Optical Engineering, Jan 2013
paper, video
Subjective evaluation on visual perceptibility of embedding complementary patterns for nonintrusive projection-based augmented reality
Hanhoon Park, Byung-Kuk Seo, and Jong-Il Park
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), May 2010
paper
Automatic confidence adjustment of visual cues in model-based camera tracking
Hanhoon Park, Jihyun Oh, Byung-Kuk Seo, and Jong-Il Park
Computer Animation and Virtual Worlds (CAVW), Mar/Apr 2010
paper
Optimal illumination for discriminating objects with different spectra
Moon-Hyun Lee, Dong-Kyun Seo, Byung-Kuk Seo, and Jong-Il Park
Optics Letters, Sep 2009
paper
Simultaneous geometric and radiometric adaptation to dynamic surface with a mobile projector-camera system
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Jong-Il Park, Moon-Sik Jeong, Tae-Suh Park, Yongbeom Lee, and Sang-Ryong Kim
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Jan 2008
paper

Conference Paper

Exploring the value of shared experience in augmented reality games
Hye Sun Park, Byung-Kuk Seo, Gun A. Lee, and Mark Billinghurst
International Conference on Human-Computer Interaction (HCII), Jul 2020
paper
A direct method for robust model-based 3D object tracking from a monocular RGB image
Byung-Kuk Seo and Harald Wuest
European Conference on Computer Vision 2016 Workshops (ECCVW), Oct 2016
paper (author version), video
(Best Paper Award with prize money, Selected Readings 2016 in Fraunhofer IGD)
3D trajectory reconstruction under refraction at a cylindrical surface
Byung-Kuk Seo, Jungsik Park, and Jong-Il Park
IEEE International Conference on Image Processing (ICIP), Sep 2015
paper
Interactive augmented reality system using a non-contact tactile interface
Daeseon Lee, Junyeong Choi, Byung-Kuk Seo, and Jong‐Il Park
International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), Jun 2013
Fast stereo image rectification using mobile GPU
Jungsik Park, Junyeong Choi, Byung-Kuk Seo, and Jong‐Il Park
International Conference on Digital Information Processing and Communications (ICDIPC), Jun 2013
paper (open access)
A framework of augmented reality on 3-D mobile display using stereo camera tracking
Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
International Workshop on Advanced Image Technology (IWAIT), Jan 2013
Semi-automatic interactive modeling for model-based camera tracking
Eun Joo Rhee, Kangsoo Kim, Byung-Kuk Seo, and Jong-Il Park
IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC), Sep 2012
paper
3-D visual tracking for mobile augmented reality applications
Byung-Kuk Seo, Jungsik Park, and Jong-Il Park
IEEE International Conference on Multimedia and Expo (ICME), Jul 2011
paper, video
Camera tracking using partially modeled 3-D objects with scene textures
Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
IEEE International Symposium on Virtual Reality Innovation (ISVRI), Mar 2011
paper, video
A tracking framework for augmented reality tours on cultural heritage sites
Byung-Kuk Seo, Kangsoo Kim, Jungsik Park, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), Dec 2010
paper (author version)
Augmented reality-based on-site tour guide: A study in Gyeongbokgung
Byung-Kuk Seo, Kangsoo Kim, and Jong-Il Park
Asian Conference on Computer Vision 2010 Workshops (ACCVW), Nov 2010
paper (author version), video
Robust hand detection for augmented reality interface
Junyeong Choi, Byung-Kuk Seo, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI), Dec 2009
paper
Natural interaction with virtual pet on your palm
Junyeong Choi, Jae-Hyek Han, Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
International Workshop on Advanced Image Technology (IWAIT), Jan 2009
Object-adaptive tracking for AR guidance system
Hanhoon Park, Jihyun Oh, Byung-kuk Seo, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), Dec 2008
paper
(Best Paper Award)
One-handed interaction with augmented virtual objects on mobile devices
Byung-Kuk Seo, Junyeong Choi, Jae-Hyek Han, Hanhoon Park, and Jong-Il Park
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), Dec 2008
paper (author version)
Direct-projected augmented reality for robot-assisted surgery
Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, Jong-Il Park, and Young Soo Kim
International Symposium on Robotics (ISR), Oct 2008
paper
A nonintrusive method for generating all-focused projection
Hanhoon Park, Byung-Kuk Seo, and Jong-Il Park
IEEE International Conference on Image Processing (ICIP), Oct 2008
paper
Projection-based diminished reality system
Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, and Jong-Il Park
International Symposium on Ubiquitous Virtual Reality (ISUVR), Jul 2008
paper
Direct-projected AR based interactive user interface for medical surgery
Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, and Jong-Il Park
International Conference on Artificial Reality and Telexistence (ICAT), Nov 2007
paper
Portable projection-based AR system
Ji-Hyun Oh, Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, and Jong-Il Park
International Symposium on Visual Computing (ISVC), Nov 2007
paper
Content adaptive embedding of complementary patterns for nonintrusive direct-projected augmented reality
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Yoonjong Jin, and Jong-Il Park
International Conference on Human-Computer Interaction (HCII), Jul 2007
paper
Radiometrically-compensated projection onto non-Lambertian surface using multiple overlapping projectors
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, Hong-Chang Shin, and Jong-Il Park
Pacific-Rim Symposium on Image and Video Technology (PSIVT), Dec 2006
paper
Undistorted projection onto dynamic surface
Hanhoon Park, Moon-Hyun Lee, Byung-Kuk Seo, and Jong-Il Park
Pacific-Rim Symposium on Image and Video Technology (PSIVT), Dec 2006
paper

Conference Paper (up to two-page poster, abstract, demo)

  • Robust 3D object tracking using an elaborate motion model
    Byung-Kuk Seo and Harald Wuest
    IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Sep 2016
    paper (author version), video
    (Best Poster Paper Runner Up Award)
  • Interactive deformation of real objects
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Sep 2014
    paper, video
  • Interactive virtual manipulation of a 3D real object using visual tracking
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    International Workshop on Advanced Image Technology (IWAIT), Jan 2014
  • RGB-D camera-based hand shape recognition for human-robot interaction
    Junyeong Choi, Byung-Kuk Seo, Daeseon Lee, Hanhoon Park, and Jong‐Il Park
    International Symposium on Robotics (ISR), Sep 2013
  • Stereo endoscope-based 3D surface reconstruction for image-guided system
    Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    Asian Conference on Computer Aided Surgery (ACCAS), Sep 2013
  • A practical solution for natural hand interaction in surgical environments
    Daeseon Lee, Junyeong Choi, Byung-Kuk Seo, and Jong‐Il Park
    Asian Conference on Computer Aided Surgery (ACCAS), Sep 2013
  • stAR: Visualizing constellations with star retrieval
    Byung-Kuk Seo, Hideaki Uchiyama, and Jong-Il Park
    ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia), Dec 2011
    paper, video
  • Augmented reality tour system for immersive experience of cultural heritage
    Kangsoo Kim, Byung-Kuk Seo, Jae-Hyek Han, and Jong-Il Park
    ACM SIGGRAPH International Conference on Virtual Reality Continuum and its Applications in Industry (VRCAI), Dec 2009
    paper
  • MeDAR: Medical direct-projected augmented reality
    Byung-Kuk Seo, Moon-Hyun Lee, and Jong-Il Park
    Asian Conference on Computer Aided Surgery (ACCAS), Jul 2009
    (Best Poster Presentation Award)
  • Virtual-pen for computer aided surgery
    Byung-Kuk Seo, Moon-Hyun Lee, Hanhoon Park, Jong-Il Park, and Young Soo Kim
    International Congress and Exhibition on Computer Assisted Radiology and Surgery (CARS), Jun 2007
  • Implementation of direct-projected augmented reality system on wet surface
    Moon-Hyun Lee, Hanhoon Park, Byung-Kuk Seo, Hong-Chang Shin, and Jong-Il Park
    World Congress on Medical Physics and Biomedical Engineering (WC), 2006

Misc (technical report, presentation)

  • ACMT: Advanced CAD model tracking
    Byung-Kuk Seo and Harald Wuest
    Technical Report, Jul 2016
  • Model-based tracking in highly cluttered backgrounds
    Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    Korea-Japan Workshop on Mixed Reality (KJMR), Apr 2013
    (Best Presentation Award)
  • Tolerance analysis of model-based camera tracking by modeling errors
    Eun Joo Rhee, Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Jan 2013
  • 3-D model-based tracking on a mobile phone
    Jungsik Park, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Workshop on Mixed Reality (KJMR), Apr 2011
  • Optimal illumination spectrum for endoscope
    Moon-Hyun Lee, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Feb 2011
  • Model-based tracking in partially known scenes
    Byung-Kuk Seo, Hanhoon Park, and Jong-Il Park
    Korea-Japan Workshop on Mixed Reality (KJMR), Apr 2010
  • Optimal illumination for discriminating objects with different spectra
    Moon-Hyun Lee, Dong-Kyun Seo, Byung-Kuk Seo, and Jong-Il Park
    Joint Workshop between Hanyang University and Shanghai Jiao Tong University, Aug 2010
  • Change-of-light compensation for intelligent image projection
    Moon-Hyun Lee, Byung-Kuk Seo, and Jong-Il Park
    Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), Feb 2009

Misc (papers in Korean)

  • 12 journal articles / 23 conference papers
    (details are not listed here)

Thesis

  • Model-based visual tracking of textureless 3D rigid objects
    Ph.D. dissertation, Feb 2014
    Committee: Prof. Jechang Jeong (chair), Prof. Euee S. Jang, Prof. Jongwoo Lim, Dr. Slobodan Ilic, and Prof. Jong-Il Park (supervisor)
    (Best Doctoral Dissertation Award in Engineering)
  • Projection-based interactive augmented reality system
    M.Sc. thesis, Feb 2008
    Committee: Prof. Jechang Jeong (chair), Prof. Whoi-Yul Kim, and Prof. Jong-Il Park (supervisor)

Patent/Copyright

Application

  • Physical phenomena simulation method for expressing the physical phenomena in mixed reality, and mixed reality apparatus that performs the method, 10-2021-0051015; applied in South Korea, Apr 2021
  • Method for providing augmented reality based on multi-user interaction with real objects and apparatus using the same, 17/151992; applied in United States, Jan 2021
  • Method for providing augmented reality based on multi user using interaction with real object and apparatus using the same, 10-2020-0011937; applied in South Korea, Jan 2020
  • Method for providing user-customized augmented reality service and apparatus using the same, 16/664607; applied in United States, Oct 2019
  • Method for creating collider for interaction of real object and virtual object and apparatus using the same, 10-2019-0082400; applied in South Korea, Jul 2019
  • User-customized AR interaction method & apparatus, 10-2019-0034304; applied in South Korea, Mar 2019
  • Method for providing augmented reality based on multi-user and apparatus using the same, 10-2018-008994; applied in South Korea, Aug 2018

Patent (granted)

  • Method for providing augmented reality contents
    10-2074370 B1; issued in South Korea, Jan 2020
  • Method for obtaining full reflectance spectrum of a surface and apparatus therefor
    10-1958493 B1; issued in South Korea, Mar 2019
  • Wearable display device having a sliding structure
    10-1952974 B1; issued in South Korea, Feb 2019
  • Wearable display device
    10-1952973 B1; issued in South Korea, Feb 2019
  • Wearable display device having a detection function
    10-1952972 B1; issued in South Korea, Feb 2019
  • Apparatus and method for providing haptic on virtual video
    10-1906633 B1; issued in South Korea, Oct 2018
  • Apparatus and method for providing haptic which cooperates with display apparatus
    10-1906634 B1; issued in South Korea, Oct 2018
  • Wearable display device using augmented reality
    10-1891837 B1; issued in South Korea, Aug 2018
  • Wrist-wearable display apparatus and method for controlling the same
    US 9,971,381 B2; issued in United Sates, May 2018
  • Method for obtaining full reflectance spectrum of a surface and apparatus therefor
    US 9,778,109 B2; issued in United States, Oct 2017
  • Wearable display device having a sliding structure
    US 9,726,895 B2; issued in United States, Aug 2017
  • Wearable display device having a detection function
    US 9,568,735 B2; issued in United States, Feb 2017
  • Wearable display device
    US 9,465,216 B2; issued in United States, Oct 2016
  • Wearable display device having a sliding structure
    US 9,329,391 B2; issued in United States, May 2016
  • Apparatus and method for providing tactile sensation for virtual image
    US 9,323,330 B2; issued in United States, Apr 2016
  • Apparatus and method for providing tactile sensation in cooperation with display device
    US 9,317,121 B2; issued in United States, Apr 2016
  • Wearable display apparatus for wrist and method for controlling the same
    10-1489620 B1; issued in South Korea, Jan 2015
  • Markerless hand-based interface for wearable display
    10-1476503 B1; issued in South Korea, Dec 2014
  • Apparatus and method for providing haptic which cooperates with display apparatus
    10-1428880 B1; issued in South Korea, Aug 2014
  • Wearable display device
    10-1396005 B1; issued in South Korea, May 2014
  • Wearable display device having sensing function
    10-1375868 B1; issued in South Korea, Mar 2014
  • Apparatus and method for providing haptic on virtual video
    10-1370090 B1; issued in South Korea, Feb 2014
  • Wearable display device having a sliding structure
    10-1321157 B1; issued in South Korea, Oct 2013
  • System and method for providing tactile in augmented reality based marker
    10-1194957 B1; issued in South Korea, Oct 2012
  • Apparatus and method for providing changed surroundings information-compliant virtual contents of 3-dimension
    10-1168116 B1; issued in South Korea, Jul 2012
  • Mobile augmented reality system for interaction with 3D virtual objects and method thereof
    10-0980202 B1; issued in South Korea, Aug 2010
  • Medical image providing system and method of providing a medical image using the same
    10-0877114 B1; issued in South Korea, Dec 2008 (expired in 2017)

Copyright (software)

  • A software of S3LAM (Sparse Stereo Simultaneous Localization and Mapping) module
    C-2018-010107; issued in South Korea, Apr 2018
  • A software of K-AR project
    C-2018-001955; issued in South Korea, Jan 2018
  • A software of 3D object tracking for mobile augmented reality
    C-2014-015073; issued in South Korea, Jun 2014