Hoi-Jun+Yoo
-
KAIST develops 'MetaVRain' that realizes vivid 3D real-life images
KAIST (President Kwang Hyung Lee) is a high-speed, low-power artificial intelligence (AI: Artificial Intelligent) semiconductor* MetaVRain, which implements artificial intelligence-based 3D rendering that can render images close to real life on mobile devices.
* AI semiconductor: Semiconductor equipped with artificial intelligence processing functions such as recognition, reasoning, learning, and judgment, and implemented with optimized technology based on super intelligence, ultra-low power, and ultra-reliability
The artificial intelligence semiconductor developed by the research team makes the existing ray-tracing*-based 3D rendering driven by GPU into artificial intelligence-based 3D rendering on a newly manufactured AI semiconductor, making it a 3D video capture studio that requires enormous costs. is not needed, so the cost of 3D model production can be greatly reduced and the memory used can be reduced by more than 180 times. In particular, the existing 3D graphic editing and design, which used complex software such as Blender, is replaced with simple artificial intelligence learning, so the general public can easily apply and edit the desired style.
* Ray-tracing: Technology that obtains images close to real life by tracing the trajectory of all light rays that change according to the light source, shape and texture of the object
This research, in which doctoral student Donghyun Han participated as the first author, was presented at the International Solid-State Circuit Design Conference (ISSCC) held in San Francisco, USA from February 18th to 22nd by semiconductor researchers from all over the world.
(Paper Number 2.7, Paper Title: MetaVRain: A 133mW Real-time Hyper-realistic 3D NeRF Processor with 1D-2D Hybrid Neural Engines for Metaverse on Mobile Devices (Authors: Donghyeon Han, Junha Ryu, Sangyeob Kim, Sangjin Kim, and Hoi-Jun Yoo))
Professor Yoo's team discovered inefficient operations that occur when implementing 3D rendering through artificial intelligence, and developed a new concept semiconductor that combines human visual recognition methods to reduce them. When a person remembers an object, he has the cognitive ability to immediately guess what the current object looks like based on the process of starting with a rough outline and gradually specifying its shape, and if it is an object he saw right before. In imitation of such a human cognitive process, the newly developed semiconductor adopts an operation method that grasps the rough shape of an object in advance through low-resolution voxels and minimizes the amount of computation required for current rendering based on the result of rendering in the past.
MetaVRain, developed by Professor Yu's team, achieved the world's best performance by developing a state-of-the-art CMOS chip as well as a hardware architecture that mimics the human visual recognition process. MetaVRain is optimized for artificial intelligence-based 3D rendering technology and achieves a rendering speed of up to 100 FPS or more, which is 911 times faster than conventional GPUs. In addition, as a result of the study, the energy efficiency, which represents the energy consumed per video screen processing, is 26,400 times higher than that of GPU, opening the possibility of artificial intelligence-based real-time rendering in VR/AR headsets and mobile devices.
To show an example of using MetaVRain, the research team developed a smart 3D rendering application system together, and showed an example of changing the style of a 3D model according to the user's preferred style. Since you only need to give artificial intelligence an image of the desired style and perform re-learning, you can easily change the style of the 3D model without the help of complicated software. In addition to the example of the application system implemented by Professor Yu's team, it is expected that various application examples will be possible, such as creating a realistic 3D avatar modeled after a user's face, creating 3D models of various structures, and changing the weather according to the film production environment. do.
Starting with MetaVRain, the research team expects that the field of 3D graphics will also begin to be replaced by artificial intelligence, and revealed that the combination of artificial intelligence and 3D graphics is a great technological innovation for the realization of the metaverse.
Professor Hoi-Jun Yoo of the Department of Electrical and Electronic Engineering at KAIST, who led the research, said, “Currently, 3D graphics are focused on depicting what an object looks like, not how people see it.” The significance of this study was revealed as a study that enabled efficient 3D graphics by borrowing the way people recognize and express objects by imitating them.” He also foresaw the future, saying, “The realization of the metaverse will be achieved through innovation in artificial intelligence technology and innovation in artificial intelligence semiconductors, as shown in this study.”
Figure 1. Description of the MetaVRain demo screen
Photo of Presentation at the International Solid-State Circuits Conference (ISSCC)
2023.03.13 View 4565 -
A New Family of Ducks joins the Feathery KAISTians
In October of this year, KAIST signed an 'Agreement for the Training Program for AI Semiconductor Designers' with Samsung Electronics, to conduct joint research and actively nurture master's and doctorate researchers in the field of Semiconductors designed exclusively for AI devices. To celebrate this commemorative agreement for cooperation bound for mutual success, Samsung Electronics gifted a set of 5 ducks to KAIST.
The Duck Pond and the Geese have been representing KAIST as famous mascots.
It all started back in 2000, when the incumbent President, Professor Kwang Hyung Lee served was then a professor at the Department of Bio and Brain Engineering, he first picked up a pack of ducks from Yuseong Market and started taking care of it on campus around the Carillon pond. While the ducks came and went, eventually being replaced with a pack of geese over the time, for more than 20 years, the pack of feathery KAISTians stole the eyes of the passersby and were loved by both the on-campus members and the visitors, alike.
The representative of the Samsung Electronics said that the pack of ducks comprising of a new breed contains the message of SEC that it hopes that the PIM semiconductor technology will grow to become the super-gap technology that would turn heads and grab attention of the world as the mascot of Korea's technological prowess under the combined care of KAIST and SEC.
Would the ducks find KAIST likable? We will keep you informed of how they are doing!
2022.11.01 View 3643 -
Shaping the AI Semiconductor Ecosystem
- As the marriage of AI and semiconductor being highlighted as the strategic technology of national enthusiasm, KAIST's achievements in the related fields accumulated through top-class education and research capabilities that surpass that of peer universities around the world are standing far apart from the rest of the pack.
As Artificial Intelligence Semiconductor, or a system of semiconductors designed for specifically for highly complicated computation need for AI to conduct its learning and deducing calculations, (hereafter AI semiconductors) stand out as a national strategic technology, the related achievements of KAIST, headed by President Kwang Hyung Lee, are also attracting attention. The Ministry of Science, ICT and Future Planning (MSIT) of Korea initiated a program to support the advancement of AI semiconductor last year with the goal of occupying 20% of the global AI semiconductor market by 2030. This year, through industry-university-research discussions, the Ministry expanded to the program with the addition of 1.2 trillion won of investment over five years through 'Support Plan for AI Semiconductor Industry Promotion'. Accordingly, major universities began putting together programs devised to train students to develop expertise in AI semiconductors.
KAIST has accumulated top-notch educational and research capabilities in the two core fields of AI semiconductor - Semiconductor and Artificial Intelligence. Notably, in the field of semiconductors, the International Solid-State Circuit Conference (ISSCC) is the world's most prestigious conference about designing of semiconductor integrated circuit. Established in 1954, with more than 60% of the participants coming from companies including Samsung, Qualcomm, TSMC, and Intel, the conference naturally focuses on practical value of the studies from the industrial point-of-view, earning the nickname the ‘Semiconductor Design Olympics’. At such conference of legacy and influence, KAIST kept its presence widely visible over other participating universities, leading in terms of the number of accepted papers over world-class schools such as Massachusetts Institute of Technology (MIT) and Stanford for the past 17 years.
Number of papers published at the InternationalSolid-State Circuit Conference (ISSCC) in 2022 sorted by nations and by institutions
Number of papers by universities presented at the International Solid-State Circuit Conference (ISCCC) in 2006~2022
In terms of the number of papers accepted at the ISSCC, KAIST ranked among top two universities each year since 2006. Looking at the average number of accepted papers over the past 17 years, KAIST stands out as an unparalleled leader. The average number of KAIST papers adopted during the period of 17 years from 2006 through 2022, was 8.4, which is almost double of that of competitors like MIT (4.6) and UCLA (3.6). In Korea, it maintains the second place overall after Samsung, the undisputed number one in the semiconductor design field. Also, this year, KAIST was ranked first among universities participating at the Symposium on VLSI Technology and Circuits, an academic conference in the field of integrated circuits that rivals the ISSCC.
Number of papers adopted by the Symposium on VLSI Technology and Circuits in 2022 submitted from the universities
With KAIST researchers working and presenting new technologies at the frontiers of all key areas of the semiconductor industry, the quality of KAIST research is also maintained at the highest level. Professor Myoungsoo Jung's research team in the School of Electrical Engineering is actively working to develop heterogeneous computing environment with high energy efficiency in response to the industry's demand for high performance at low power. In the field of materials, a research team led by Professor Byong-Guk Park of the Department of Materials Science and Engineering developed the Spin Orbit Torque (SOT)-based Magnetic RAM (MRAM) memory that operates at least 10 times faster than conventional memories to suggest a way to overcome the limitations of the existing 'von Neumann structure'.
As such, while providing solutions to major challenges in the current semiconductor industry, the development of new technologies necessary to preoccupy new fields in the semiconductor industry are also very actively pursued. In the field of Quantum Computing, which is attracting attention as next-generation computing technology needed in order to take the lead in the fields of cryptography and nonlinear computation, Professor Sanghyeon Kim's research team in the School of Electrical Engineering presented the world's first 3D integrated quantum computing system at 2021 VLSI Symposium. In Neuromorphic Computing, which is expected to bring remarkable advancements in the field of artificial intelligence by utilizing the principles of the neurology, the research team of Professor Shinhyun Choi of School of Electrical Engineering is developing a next-generation memristor that mimics neurons.
The number of papers by the International Conference on Machine Learning (ICML) and the Conference on Neural Information Processing Systems (NeurIPS), two of the world’s most prestigious academic societies in the field of artificial intelligence (KAIST 6th in the world, 1st in Asia, in 2020)
The field of artificial intelligence has also grown rapidly. Based on the number of papers from the International Conference on Machine Learning (ICML) and the Conference on Neural Information Processing Systems (NeurIPS), two of the world's most prestigious conferences in the field of artificial intelligence, KAIST ranked 6th in the world in 2020 and 1st in Asia. Since 2012, KAIST's ranking steadily inclined from 37th to 6th, climbing 31 steps over the period of eight years. In 2021, 129 papers, or about 40%, of Korean papers published at 11 top artificial intelligence conferences were presented by KAIST. Thanks to KAIST's efforts, in 2021, Korea ranked sixth after the United States, China, United Kingdom, Canada, and Germany in terms of the number of papers published by global AI academic societies.
Number of papers from Korea (and by KAIST) published at 11 top conferences in the field of artificial intelligence in 2021
In terms of content, KAIST's AI research is also at the forefront. Professor Hoi-Jun Yoo's research team in the School of Electrical Engineering compensated for the shortcomings of the “edge networks” by implementing artificial intelligence real-time learning networks on mobile devices. In order to materialize artificial intelligence, data accumulation and a huge amount of computation is required. For this, a high-performance server takes care of massive computation, and for the user terminals, the “edge network” that collects data and performs simple computations are used. Professor Yoo's research greatly increased AI’s processing speed and performance by allotting the learning task to the user terminal as well.
In June, a research team led by Professor Min-Soo Kim of the School of Computing presented a solution that is essential for processing super-scale artificial intelligence models. The super-scale machine learning system developed by the research team is expected to achieve speeds up to 8.8 times faster than Google's Tensorflow or IBM's System DS, which are mainly used in the industry.
KAIST is also making remarkable achievements in the field of AI semiconductors. In 2020, Professor Minsoo Rhu's research team in the School of Electrical Engineering succeeded in developing the world's first AI semiconductor optimized for AI recommendation systems. Due to the nature of the AI recommendation system having to handle vast amounts of contents and user information, it quickly meets its limitation because of the information bottleneck when the process is operated through a general-purpose artificial intelligence system. Professor Minsoo Rhu's team developed a semiconductor that can achieve a speed that is 21 times faster than existing systems using the 'Processing-In-Memory (PIM)' technology. PIM is a technology that improves efficiency by performing the calculations in 'RAM', or random-access memory, which is usually only used to store data temporarily just before they are processed. When PIM technology is put out on the market, it is expected that fortify competitiveness of Korean companies in the AI semiconductor market drastically, as they already hold great strength in the memory area.
KAIST does not plan to be complacent with its achievements, but is making various plans to further the distance from the competitors catching on in the fields of artificial intelligence, semiconductors, and AI semiconductors. Following the establishment of the first artificial intelligence research center in Korea in 1990, the Kim Jaechul AI Graduate School was opened in 2019 to sustain the supply chain of the experts in the field. In 2020, Artificial Intelligence Semiconductor System Research Center was launched to conduct convergent research on AI and semiconductors, which was followed by the establishment of the AI Institutes to promote “AI+X” research efforts.
Based on the internal capabilities accumulated through these efforts, KAIST is also making efforts to train human resources needed in these areas. KAIST established joint research centers with companies such as Naver, while collaborating with local governments such as Hwaseong City to simultaneously nurture professional manpower. Back in 2021, KAIST signed an agreement to establish the Semiconductor System Engineering Department with Samsung Electronics and are preparing a new semiconductor specialist training program. The newly established Department of Semiconductor System Engineering will select around 100 new students every year from 2023 and provide special scholarships to all students so that they can develop their professional skills. In addition, through close cooperation with the industry, they will receive special support which includes field trips and internships at Samsung Electronics, and joint workshops and on-site training.
KAIST has made a significant contribution to the growth of the Korean semiconductor industry ecosystem, producing 25% of doctoral workers in the domestic semiconductor field and 20% of CEOs of mid-sized and venture companies with doctoral degrees. With the dawn coming up on the AI semiconductor ecosystem, whether KAIST will reprise the pivotal role seems to be the crucial point of business.
2022.08.05 View 9539 -
A Breakthrough for Cardiac Monitoring: Portable Smart Patch Makes It Possible for Real-time Observation of Heart Movement
Newly invented device makes the monitoring easier and convenient.
Professor Hoi-Jun Yoo of KAIST, Department of Electrical Engineering, said that his research team has invented a smart patch for cardiac monitoring, the first of its kind in the world. Adhesive and can be applied directly to chest in human body, the patch is embedded with a built-in high performance semiconductor integrated circuit (IC), called Healthcare IC, and with twenty five electrodes formed on the patch’s surface.
The 25-electrodes, with a capability of creating various configurations, can detect cardiac contractions and relaxations and collect electrocardiogram (ECG) signals. The Healthcare IC monitors ECG signals and sends the information to a portable data terminal like mobile phones, making it possible for a convenient, easy check up on cardiac observations.
The key technologies used for the patch are the Healthcare IC that measures cardiovascular impedance and ECG signals, and the electronic circuit board made of four layers of fabric, between which electrodes, wireless antenna, circuit board, and flexible battery are installed. With the P-FCB (Planar Fashionable Circuit Board) technology, the research team explained, electrodes and a circuit board are directly stacked into the fabric. Additionally, the Healthcare IC (size: 5mm x 5mm), which has components of electrode control unit, ECG and cardiovascular resistance detection unit, data compression unit, Static Random Access Memory (SRAM), and wireless transmitter receiver, is attached on the fabric. The Healthcare IC is operated by an ultra-low electrical power.
Like a medicated patch commonly used to relieve arthritis pains, the surface of smart patch is adhesive so that people can carry it around without much hassle. A finished product will be 15cm x 15 cm in size and 1mm high in thickness. The Healthcare IC can measure cardiovascular impedance variances with less than 0.81% distortion in 16 different configurations through differential current injectors and reconfigurable high sensitivity detection circuitry.
“The patch will be ideal for patients who suffer a chronic heart disease and need to receive a continuous care for their condition. Once commercialized, the patch will allow the patients to conduct a self-diagnosis at anytime and anywhere,” said Yan Long, a member of the research team.
There has been a continuously growing demand worldwide since 2000 for the development of technology that provides a suitable healthcare management to patients with a chronic heart disease (e.g., cardiovascular problems), but most of the technology developed today are only limited to monitoring electrical signals of heart activity. Cardiovascular monitors, commonly used at many of healthcare places nowadays, are too bulky to use and give uncomfortable feelings to patients when applied. Besides, the current monitors are connected to an electrical line for power supply, and they are unable to have a low power communication with an outdoor communication gadget, thus unavailable for wide use.
Professor Yoo gave his presentation on this new invention at an international conference, International Solid-State Circuits Conference, held on February 8-10 in San Francisco. The subject of his presentation was “A 3.9mW 25-electorde Reconfigurable Thoracic Impedance/ECG SoC with Body-Channel Transponder.”
(Picture 1) Structure of Smart Patch
(Picture 2) Smart patch when applied onto human body
(Picture 3) Data received from smart patch
(Picture 4) Healthcare IC
2010.02.17 View 13759 -
Workshop on Biomedical IC to Be Held on March 26
KAIST will hold a workshop on "biomedical IC for future healthcare system" on March 26 at a lecture room of the School of Electrical Engineering & Computer Science. The workshop is organized by SEECS and the Korean Institute of Next Generation Computing.
At the workshop, a variety of new technologies expected to expedite the development of biomedical systems will be presented. KAIST Prof. Hoi-Jun Yoo will speak on the "body channel communication" using the human body as the signal transmission medium and Dr. Seung-Hwan Kim of Electronics and Telecommunications Research Institute (ETRI) on a wearable vital sign monitoring system.
Other subjects are CMOS (complementary metal-oxide semiconductor) fully electronic biosensor for biomolecular detection to be presented by KAIST Prof. Gyu-Hyeong Cho; nerve interface and IC (integrated circuit) system design by KAIST Prof. Yoon-gi Nam; design of neural recording and stimulation IC using time-varying magnetic field by KAIST Prof. Seong-Hwan Cho; low power multi-core digital signal processor for hearing aid by Dong-Wook Kim, senior researcher at the Samsung Advanced Institute of Technology; and a non-contact cardiac sensor by KAIST Prof. Seung-Chul Hong.
With the advent of the ageing society, medical expenses of the elderly people are rapidly increasing. As a way to address the issue, interests are growing in "ubiquitous healthcare," a technology that uses a large number of environmental and patient sensors and actuators to monitor and improve patients’ physical and mental condition.
The upcoming workshop is the first academic event on biomedical integrated chips to be held in Korea. The workshop will provide a valuable opportunity for experts in biomedical area to get together and examine the present status of Korean biomedical area and discuss about its future, KAIST officials said.
2009.03.20 View 16638
-
Three Professors Selected as IEEE Fellows
Three Korea Advanced Institute of Science and Technology (KAIST)’s professors, Ju-Jang Lee, Yong-Hee Lee, and Hoi-Jun Yoo, were selected as a part of the 2008 Institute of Electrical and Electronics Engineers, Inc (IEEE)’s “Fellows.” A Fellow is the highest level of membership given only to those “with an extraordinary record of accomplishments” in their field of study. Although some IEEE memberships can be gained freely by all, the Fellow status is bestowed only by the IEEE Board of Directors.
Professor Ju-Jang Lee was awarded the Fellow status “for contributions to intelligent robust control and robotics.” Robust control is a system’s stable maintenance under many inputs in a dynamic environment. A part of KAIST’s Electrical Engineering Department, Professor Ju-Jang Lee has conducted successful research in these fields, and has published 538 papers. He also holds many patents in and outside of the country, and is the General Chair for two upcoming IEEE conferences in 2008 and 2009.
Professor Yong-Hee Lee of KAIST’s Physics Department was recognized for his “contributions to photonic devices based upon vertical cavity surface emitting lasers and photonic crystals.” Photonic devices are those that allow the practical use of photons, and photon crystals are structures that affect the motion of photons. Professor Yong-Hee Lee is an expert in the field of Photonics and his works have been cited over 2500 times. He is also an outstanding speaker, giving over 30 lectures in front of international audiences in the past 5 years, and receiving The Distinguished Lecturer’s Award from IEEE.
Professor Hoi-Jun Yoo was granted the prestigious Fellow status for his “contributions to low-power and high-speed VLSI design.” VLSI stands for ‘very large scale integration’ and refers to the skill for packing a huge number of semiconductors on an integrated circuit. Professor Lee’s Fellow status is noteworthy in that he studied, worked, and researched solely in Korea. He is also the youngest of the three KAIST professors to be granted membership in the class of 2008 Fellowship. IEEE also recognized Professor Yoo as the most frequent publisher during the past 8 years.
IEEE, originally concentrating on Electric Engineering, has now branched into many related fields. It is a nonprofit organization, and its aim is to be the world"s leading professional association for the advancement of technology. For its Fellow Class of 2008, 295 members were chosen; which is less that 0.1% of their total members.By KAIST Herald on December, 2007
2007.12.21 View 17105