AND
-
Image Analysis to Automatically Quantify Gender Bias in Movies
Many commercial films worldwide continue to express womanhood in a stereotypical manner, a recent study using image analysis showed. A KAIST research team developed a novel image analysis method for automatically quantifying the degree of gender bias in films.
The ‘Bechdel Test’ has been the most representative and general method of evaluating gender bias in films. This test indicates the degree of gender bias in a film by measuring how active the presence of women is in a film. A film passes the Bechdel Test if the film (1) has at least two female characters, (2) who talk to each other, and (3) their conversation is not related to the male characters.
However, the Bechdel Test has fundamental limitations regarding the accuracy and practicality of the evaluation. Firstly, the Bechdel Test requires considerable human resources, as it is performed subjectively by a person. More importantly, the Bechdel Test analyzes only a single aspect of the film, the dialogues between characters in the script, and provides only a dichotomous result of passing the test, neglecting the fact that a film is a visual art form reflecting multi-layered and complicated gender bias phenomena. It is also difficult to fully represent today’s various discourse on gender bias, which is much more diverse than in 1985 when the Bechdel Test was first presented.
Inspired by these limitations, a KAIST research team led by Professor Byungjoo Lee from the Graduate School of Culture Technology proposed an advanced system that uses computer vision technology to automatically analyzes the visual information of each frame of the film. This allows the system to more accurately and practically evaluate the degree to which female and male characters are discriminatingly depicted in a film in quantitative terms, and further enables the revealing of gender bias that conventional analysis methods could not yet detect.
Professor Lee and his researchers Ji Yoon Jang and Sangyoon Lee analyzed 40 films from Hollywood and South Korea released between 2017 and 2018. They downsampled the films from 24 to 3 frames per second, and used Microsoft’s Face API facial recognition technology and object detection technology YOLO9000 to verify the details of the characters and their surrounding objects in the scenes.
Using the new system, the team computed eight quantitative indices that describe the representation of a particular gender in the films. They are: emotional diversity, spatial staticity, spatial occupancy, temporal occupancy, mean age, intellectual image, emphasis on appearance, and type and frequency of surrounding objects.
Figure 1. System Diagram
Figure 2. 40 Hollywood and Korean Films Analyzed in the Study
According to the emotional diversity index, the depicted women were found to be more prone to expressing passive emotions, such as sadness, fear, and surprise. In contrast, male characters in the same films were more likely to demonstrate active emotions, such as anger and hatred.
Figure 3. Difference in Emotional Diversity between Female and Male Characters
The type and frequency of surrounding objects index revealed that female characters and automobiles were tracked together only 55.7 % as much as that of male characters, while they were more likely to appear with furniture and in a household, with 123.9% probability.
In cases of temporal occupancy and mean age, female characters appeared less frequently in films than males at the rate of 56%, and were on average younger in 79.1% of the cases. These two indices were especially conspicuous in Korean films.
Professor Lee said, “Our research confirmed that many commercial films depict women from a stereotypical perspective. I hope this result promotes public awareness of the importance of taking prudence when filmmakers create characters in films.”
This study was supported by KAIST College of Liberal Arts and Convergence Science as part of the Venture Research Program for Master’s and PhD Students, and will be presented at the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW) on November 11 to be held in Austin, Texas.
Publication:
Ji Yoon Jang, Sangyoon Lee, and Byungjoo Lee. 2019. Quantification of Gender Representation Bias in Commercial Films based on Image Analysis. In Proceedings of the 22nd ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW). ACM, New York, NY, USA, Article 198, 29 pages. https://doi.org/10.1145/3359300
Link to download the full-text paper:
https://files.cargocollective.com/611692/cscw198-jangA--1-.pdf
Profile: Prof. Byungjoo Lee, MD, PhD
byungjoo.lee@kaist.ac.kr
http://kiml.org/
Assistant Professor
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Ji Yoon Jang, M.S.
yoone3422@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
Profile: Sangyoon Lee, M.S. Candidate
sl2820@kaist.ac.kr
Interactive Media Lab
Graduate School of Culture Technology (CT)
Korea Advanced Institute of Science and Technology (KAIST)
https://www.kaist.ac.kr Daejeon 34141, Korea
(END)
2019.10.17 View 27552 -
A Mathematical Model Reveals Long-Distance Cell Communication Mechanism
How can tens of thousands of people in a large football stadium all clap together with the same beat even though they can only hear the people near them clapping?
A combination of a partial differential equation and a synthetic circuit in microbes answers this question. An interdisciplinary collaborative team of Professor Jae Kyoung Kim at KAIST, Professor Krešimir Josić at the University of Houston, and Professor Matt Bennett at Rice University has identified how a large community can communicate with each other almost simultaneously even with very short distance signaling. The research was reported at Nature Chemical Biology.
Cells often communicate using signaling molecules, which can travel only a short distance. Nevertheless, the cells can also communicate over large distances to spur collective action. The team revealed a cell communication mechanism that quickly forms a network of local interactions to spur collective action, even in large communities.
The research team used an engineered transcriptional circuit of combined positive and negative feedback loops in E. coli, which can periodically release two types of signaling molecules: activator and repressor. As the signaling molecules travel over a short distance, cells can only talk to their nearest neighbors. However, cell communities synchronize oscillatory gene expression in spatially extended systems as long as the transcriptional circuit contains a positive feedback loop for the activator.
Professor Kim said that analyzing and understanding such high-dimensional dynamics was extremely difficult. He explained, “That’s why we used high-dimensional partial differential equation to describe the system based on the interactions among various types of molecules.” Surprisingly, the mathematical model accurately simulates the synthesis of the signaling molecules in the cell and their spatial diffusion throughout the chamber and their effect on neighboring cells.
The team simplified the high-dimensional system into a one-dimensional orbit, noting that the system repeats periodically. This allowed them to discover that cells can make one voice when they lowered their own voice and listened to the others. “It turns out the positive feedback loop reduces the distance between moving points and finally makes them move all together. That’s why you clap louder when you hear applause from nearby neighbors and everyone eventually claps together at almost the same time,” said Professor Kim.
Professor Kim added, “Math is a powerful as it simplifies complex thing so that we can find an essential underlying property. This finding would not have been possible without the simplification of complex systems using mathematics."
The National Institutes of Health, the National Science Foundation, the Robert A. Welch Foundation, the Hamill Foundation, the National Research Foundation of Korea, and the T.J. Park Science Fellowship of POSCO supported the research.
(Figure: Complex molecular interactions among microbial consortia is simplified as interactions among points on a limit cycle (right).)
2019.10.15 View 29412 -
Two Professors Recognized for the National R&D Excellence 100
< Professor Haeng-Ki Lee (left) and Professor Jeong-Ho Lee (right) >
Two KAIST professors were listed among the 2019 National R&D Excellence 100 announced by the Ministry of Science and ICT and the Korea Institute of S&T Evaluation and Planning.
Professor Haeng-Ki Lee from the Department of Civil and Environmental Engineering was recognized in the field of mechanics and materials for his research on developing new construction materials through the convergence of nano- and biotechnologies.
In the field of life and marine science, Professor Jeong-Ho Lee from the Graduate School of Medical Science and Engineering was lauded for his research of diagnostic tools and therapies for glioblastoma and pediatric brain tumors.
A certificate from the Minister of Ministry of Science and ICT will be conferred to these two professors, and their names will be inscribed on a special 2019 National R&D Excellence 100 plaque to celebrate their achievements. The professors will also be given privileges during the process of new R&D project selection.
(END)
2019.10.15 View 13613 -
Professor Byong-Guk Park Named Scientist of October
< Professor Byong-Guk Park >
Professor Byong-Guk Park from the Department of Materials Science and Engineering was selected as the ‘Scientist of the Month’ for October 2019 by the Ministry of Science and ICT and the National Research Foundation of Korea. Professor Park was recognized for his contributions to the advancement of spin-orbit torque (SOT)-based magnetic random access memory (MRAM) technology. He received 10 million KRW in prize money.
A next-generation, non-volatile memory device MRAM consists of thin magnetic films. It can be applied in “logic-in-memory” devices, in which logic and memory functionalities coexist, thus drastically improving the performance of complementary metal-oxide semiconductor (CMOS) processors. Conventional MRAM technology is limited in its ability to increase the operation speed of a memory device while maintaining a high density.
Professor Park tackled this challenge by introducing a new material, antiferromagnet (IrMn), that generates a sizable amount of SOT as well as an exchange-bias field, which makes successful data writing possible without an external magnetic field. This research outcome paved the way for the development of MRAM, which has a simple device structure but features high speeds and density.
Professor Park said, “I feel rewarded to have forwarded the feasibility and applicability of MRAM. I will continue devoting myself to studying further on the development of new materials that can help enhance the performance of memory devices."
(END)
2019.10.10 View 11458 -
Object Identification and Interaction with a Smartphone Knock
(Professor Lee (far right) demonstrate 'Knocker' with his students.)
A KAIST team has featured a new technology, “Knocker”, which identifies objects and executes actions just by knocking on it with the smartphone. Software powered by machine learning of sounds, vibrations, and other reactions will perform the users’ directions.
What separates Knocker from existing technology is the sensor fusion of sound and motion. Previously, object identification used either computer vision technology with cameras or hardware such as RFID (Radio Frequency Identification) tags. These solutions all have their limitations. For computer vision technology, users need to take pictures of every item. Even worse, the technology will not work well in poor lighting situations. Using hardware leads to additional costs and labor burdens.
Knocker, on the other hand, can identify objects even in dark environments only with a smartphone, without requiring any specialized hardware or using a camera. Knocker utilizes the smartphone’s built-in sensors such as a microphone, an accelerometer, and a gyroscope to capture a unique set of responses generated when a smartphone is knocked against an object. Machine learning is used to analyze these responses and classify and identify objects.
The research team under Professor Sung-Ju Lee from the School of Computing confirmed the applicability of Knocker technology using 23 everyday objects such as books, laptop computers, water bottles, and bicycles. In noisy environments such as a busy café or on the side of a road, it achieved 83% identification accuracy. In a quiet indoor environment, the accuracy rose to 98%.
The team believes Knocker will open a new paradigm of object interaction. For instance, by knocking on an empty water bottle, a smartphone can automatically order new water bottles from a merchant app. When integrated with IoT devices, knocking on a bed’s headboard before going to sleep could turn off the lights and set an alarm. The team suggested and implemented 15 application cases in the paper, presented during the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2019) held in London last month.
Professor Sung-Ju Lee said, “This new technology does not require any specialized sensor or hardware. It simply uses the built-in sensors on smartphones and takes advantage of the power of machine learning. It’s a software solution that everyday smartphone users could immediately benefit from.” He continued, “This technology enables users to conveniently interact with their favorite objects.”
The research was supported in part by the Next-Generation Information Computing Development Program through the National Research Foundation of Korea funded by the Ministry of Science and ICT and an Institute for Information & Communications Technology Promotion (IITP) grant funded by the Ministry of Science and ICT.
Figure: An example knock on a bottle. Knocker identifies the object by analyzing a unique set of responses from the knock, and automatically launches a proper application or service.
2019.10.02 View 29807 -
Professor Hyun Gyu Park Appointed as Associate Editor for Biosensors and Bioelectronics
Professor Hyun Gyu Park from the Department of Chemical and Biomolecular Engineering was appointed as an associate editor for Biosensors and Bioelectronics, an international journal published by Elsevier.
Biosensors and Bioelectronics is one of the top SCI journals in the fields of chemistry and analytical science (IF 9.518 as of 2018). Professor Park was recognized and appointed as the associate editor for this journal due to his outstanding research achievements in the fields of nucleic acid engineering, biosensors, and nanobiotechnology.
Professor Park will serve as the associate editor from this October until December 2021.
(END)
2019.10.01 View 8648 -
Accurate Detection of Low-Level Somatic Mutation in Intractable Epilepsy
KAIST medical scientists have developed an advanced method for perfectly detecting low-level somatic mutation in patients with intractable epilepsy. Their study showed that deep sequencing replicates of major focal epilepsy genes accurately and efficiently identified low-level somatic mutations in intractable epilepsy.
According to the study, their diagnostic method could increase the accuracy up to 100%, unlike the conventional sequencing analysis, which stands at about 30% accuracy. This work was published in Acta Neuropathologica.
Epilepsy is a neurological disorder common in children. Approximately one third of child patients are diagnosed with intractable epilepsy despite adequate anti-epileptic medication treatment.
Somatic mutations in mTOR pathway genes, SLC35A2, and BRAF are the major genetic causes of intractable epilepsies. A clinical trial to target Focal Cortical Dysplasia type II (FCDII), the mTOR inhibitor is underway at Severance Hospital, their collaborator in Seoul, Korea. However, it is difficult to detect such somatic mutations causing intractable epilepsy because their mutational burden is less than 5%, which is similar to the level of sequencing artifacts. In the clinical field, this has remained a standing challenge for the genetic diagnosis of somatic mutations in intractable epilepsy.
Professor Jeong Ho Lee’s team at the Graduate School of Medical Science and Engineering analyzed paired brain and peripheral tissues from 232 intractable epilepsy patients with various brain pathologies at Severance Hospital using deep sequencing and extracted the major focal epilepsy genes.
They narrowed down target genes to eight major focal epilepsy genes, eliminating almost all of the false positive calls using deep targeted sequencing. As a result, the advanced method robustly increased the accuracy and enabled them to detect low-level somatic mutations in unmatched Formalin Fixed Paraffin Embedded (FFPE) brain samples, the most clinically relevant samples.
Professor Lee conducted this study in collaboration with Professor Dong Suk Kim and Hoon-Chul Kang at Severance Hospital of Yonsei University. He said, “This advanced method of genetic analysis will improve overall patient care by providing more comprehensive genetic counseling and informing decisions on alternative treatments.”
Professor Lee has investigated low-level somatic mutations arising in the brain for a decade. He is developing innovative diagnostics and therapeutics for untreatable brain disorders including intractable epilepsy and glioblastoma at a tech-startup called SoVarGen. “All of the technologies we used during the research were transferred to the company. This research gave us very good momentum to reach the next phase of our startup,” he remarked.
The work was supported by grants from the Suh Kyungbae Foundation, a National Research Foundation of Korea grant funded by the Ministry of Science and ICT, the Korean Health Technology R&D Project from the Ministry of Health & Welfare, and the Netherlands Organization for Health Research and Development.
(Figure: Landscape of somatic and germline mutations identified in intractable epilepsy patients. a Signaling pathways for all of the mutated genes identified in this study. Bold: somatic mutation, Regular: germline mutation. b The distribution of variant allelic frequencies (VAFs) of identified somatic mutations. c The detecting rate and types of identified mutations according to histopathology. Yellow: somatic mutations, green: two-hit mutations, grey: germline mutations.)
2019.08.14 View 30171 -
Synthesizing Single-Crystalline Hexagonal Graphene Quantum Dots
(Figure: Uniformly ordered single-crystalline graphene quantum dots of various sizes synthesized through solution chemistry.)
A KAIST team has designed a novel strategy for synthesizing single-crystalline graphene quantum dots, which emit stable blue light. The research team confirmed that a display made of their synthesized graphene quantum dots successfully emitted blue light with stable electric pressure, reportedly resolving the long-standing challenges of blue light emission in manufactured displays. The study, led by Professor O Ok Park in the Department of Chemical and Biological Engineering, was featured online in Nano Letters on July 5.
Graphene has gained increased attention as a next-generation material for its heat and electrical conductivity as well as its transparency. However, single and multi-layered graphene have characteristics of a conductor so that it is difficult to apply into semiconductor. Only when downsized to the nanoscale, semiconductor’s distinct feature of bandgap will be exhibited to emit the light in the graphene. This illuminating featuring of dot is referred to as a graphene quantum dot.
Conventionally, single-crystalline graphene has been fabricated by chemical vapor deposition (CVD) on copper or nickel thin films, or by peeling graphite physically and chemically. However, graphene made via chemical vapor deposition is mainly used for large-surface transparent electrodes. Meanwhile, graphene made by chemical and physical peeling carries uneven size defects.
The research team explained that their graphene quantum dots exhibited a very stable single-phase reaction when they mixed amine and acetic acid with an aqueous solution of glucose. Then, they synthesized single-crystalline graphene quantum dots from the self-assembly of the reaction intermediate. In the course of fabrication, the team developed a new separation method at a low-temperature precipitation, which led to successfully creating a homogeneous nucleation of graphene quantum dots via a single-phase reaction.
Professor Park and his colleagues have developed solution phase synthesis technology that allows for the creation of the desired crystal size for single nanocrystals down to 100 nano meters. It is reportedly the first synthesis of the homogeneous nucleation of graphene through a single-phase reaction.
Professor Park said, "This solution method will significantly contribute to the grafting of graphene in various fields. The application of this new graphene will expand the scope of its applications such as for flexible displays and varistors.”
This research was a joint project with a team from Korea University under Professor Sang Hyuk Im from the Department of Chemical and Biological Engineering, and was supported by the National Research Foundation of Korea, the Nano-Material Technology Development Program from the Electronics and Telecommunications Research Institute (ETRI), KAIST EEWS, and the BK21+ project from the Korean government.
2019.08.02 View 35236 -
FIRIC-EU JRC Joint Workshop on Smart Specialization
The Fourth Industrial Revolution Intelligence Center (FIRIC) at KAIST discussed ‘Smart Specialization’ for regional innovation and economic growth in the wake of the Fourth Industrial Revolution during the workshop with the EU Joint Research Center (EU-JRC) in Seville, Spain last week. The two sides also agreed to sign an MOU to expand mutual collaboration.
KAIST’s FIRIC was founded in cooperation with the World Economic Forum in July 2017 to carry out policy research for the promotion of science and technology-based inclusive growth and innovation and to lead related global efforts. The EU-JRC has committed to developing cohesive policies that aim to narrow regional gaps within the European Union. Founded in 1958 in Brussels, the EU-JRC has long been in charge of EU strategies for regional innovation based on emerging technologies.
The workshop also covered issues related to public-private partnerships and innovation clusters from the perspective of the EU and Asia, such as the global value chain and the implementation of industrial clusters policy amid the changes in the industrial ecosystem due to digitalization, automation, and the utilization of robotics during the Fourth Industrial Revolution.
In addition, the session included discussions on inclusive growth and job market changes in the era of the Fourth Industrial Revolution, addressing how Smart Specialization and the outcomes of the 4IR will shift the paradigm of current job and technology capabilities, as well as employment issues in many relevant industries. In particular, the actual case studies and their related policies and regulatory trends regarding the potential risks and ethical issues of artificial intelligence were introduced.
Regarding the financial services that utilize blockchain technologies and the establishment of public sector governance for such technologies, the participating experts noted difficulties in the diffusion of blockchain-based local currencies or public services, which call for a sophisticated analytical and practical framework for innovative and transparent governance.
Dr. Mark Boden, the Team Leader of the EU-JRC, introduced the EU’s initiatives to promote Smart Specialization, such as its policy process, governance design, vision sharing, and priority setting, with particular emphasis on targeted support for Smart Specialization in lagging regions. Professor So Young Kim, who is the dean of the Graduate School of Science and Technology Policy and FIRIC’s Deputy Director said, “KAIST’s global role regarding the Fourth Industrial Revolution will be expanded in the process of exploring and developing innovative models of technology-policy governance while working jointly with the EU-JRC.”
2019.08.02 View 8330 -
'Flying Drones for Rescue'
(Video Credit: ⓒNASA JPL)
< Team USRG and Professor Shim (second from the right) >
Having recently won the AI R&D Grand Challenge Competition in Korea, Team USRG (Unmanned System Research Group) led by Professor Hyunchul Shim from the School of Electrical Engineering is all geared up to take on their next challenges: the ‘Defense Advanced Research Projects Agency Subterranean Challenge (DARPA SubT Challenge)’ and ‘Lockheed Martin’s AlphaPilot Challenge’ next month.
Team USRG won the obstacle course race in the ‘2019 AI R&D Grand Challenge Competition’ on July 12. They managed to successfully dominate the challenging category of ‘control intelligence.’ Having to complete the obstacle course race solely using AI systems without any connection to the internet made it difficult for most of the eight participating teams to pass the third section of the race, and only Team USRG passed the long pipeline course during their attempt in the main event. They also demonstrated, after the main event, that their drone can navigate all of the checkpoints including landing on the “H” mark using deep learning.
Their drone flew through polls and pipes, and escaped from windows and mazes against strong winds, amid cheers and groans from the crowd gathered at the Korea Exhibition Center (KINTEX) in Goyang, Korea. The team was awarded three million KRW in prize money, and received a research grant worth six hundred million KRW from the Ministry of Science and ICT (MSIT).
“Being ranked first in the race for which we were never given a chance for a test flight means a lot to our team. Considering that we had no information on the exact size of the course in advance, this is a startling result,” said Professor Shim. “We will carry out further research with this funding, and compete once again with the improved AI and drone technology in the 2020 competition,” he added.
The AI R&D Grand Challenge Competition, which was first started in 2017, has been designed to promote AI research and development and expand its application to addressing high-risk technical challenges with significant socio-economic impact.
This year’s competition presented participants with a task where they had to develop AI software technology for drones to navigate themselves autonomously during complex disaster relief operations such as aid delivery.
Each team participated in one of the four tracks of the competition, and their drones were evaluated based on the criteria for each track. The divisions were broken up into intelligent context-awareness, intelligent character recognition, auditory intelligence, and control intelligence.
Team USRG’s technological prowess has been already well acclaimed among international peer groups. Teamed up with NASA JPL, Caltech, and MIT, they will compete in the subterranean mission during the ‘DARPA SubT Challenge’.
Team CoSTAR, as its name stands for, is working together to build ‘Collaborative SubTerranean Autonomous Resilient Robots.’ Professor Shim emphasized the role KAIST plays in Team CoSTAR as a leader in drone technology.
“I think when our drone technology will be added to our peers’ AI and robotics, Team CoSTAR will bring out unsurpassable synergy in completing the subterrestrial and planetary applications. I would like to follow the footprint of Hubo, the winning champion of the 2015 DARPA Robotics Challenge and even extend it to subterranean exploration,” he said.
These next generation autonomous subsurface explorers are now all optimizing the physical AI robot systems developed by Team CoSTAR. They will test their systems in more realistic field environments August 15 through 22 in Pittsburgh, USA. They have already received funding from DARPA for participating.
Team CoSTAR will compete in three consecutive yearly events starting this year, and the last event, planned for 2021, will put the team to the final test with courses that incorporate diverse challenges from all three events. Two million USD will be awarded to the winner after the final event, with additional prizes of up to 200,000 USD for self-funded teams.
Team USRG also ranked third in the recent Hyundai Motor Company’s ‘Autonomous Vehicle Competition’ and another challenge is on the horizon: Lockheed Martin’s ‘AlphaPilot Challenge’. In this event, the teams will be flying their drones through a series of racing gates, trying to beat the best human pilot. The challenge is hosted by Lockheed Martin, the world’s largest military contractor and the maker of the famed F-22 and F-35 stealth fighters, with the goal of stimulating the development of autonomous drones. Team USRG was selected from out of more than 400 teams from around the world and is preparing for a series of races this fall, beginning from the end of August.
Professor Shim said, “It is not easy to perform in a series of competitions in just a few months, but my students are smart, hardworking, and highly motivated. These events indeed demand a lot, but they really challenge the researchers to come up with technologies that work in the real world. This is the way robotics really should be.”
(END)
2019.07.26 View 14079 -
Flexible User Interface Distribution for Ubiquitous Multi-Device Interaction
< Research Group of Professor Insik Shin (center) >
KAIST researchers have developed mobile software platform technology that allows a mobile application (app) to be executed simultaneously and more dynamically on multiple smart devices. Its high flexibility and broad applicability can help accelerate a shift from the current single-device paradigm to a multiple one, which enables users to utilize mobile apps in ways previously unthinkable.
Recent trends in mobile and IoT technologies in this era of 5G high-speed wireless communication have been hallmarked by the emergence of new display hardware and smart devices such as dual screens, foldable screens, smart watches, smart TVs, and smart cars. However, the current mobile app ecosystem is still confined to the conventional single-device paradigm in which users can employ only one screen on one device at a time. Due to this limitation, the real potential of multi-device environments has not been fully explored.
A KAIST research team led by Professor Insik Shin from the School of Computing, in collaboration with Professor Steve Ko’s group from the State University of New York at Buffalo, has developed mobile software platform technology named FLUID that can flexibly distribute the user interfaces (UIs) of an app to a number of other devices in real time without needing any modifications. The proposed technology provides single-device virtualization, and ensures that the interactions between the distributed UI elements across multiple devices remain intact.
This flexible multimodal interaction can be realized in diverse ubiquitous user experiences (UX), such as using live video steaming and chatting apps including YouTube, LiveMe, and AfreecaTV. FLUID can ensure that the video is not obscured by the chat window by distributing and displaying them separately on different devices respectively, which lets users enjoy the chat function while watching the video at the same time.
In addition, the UI for the destination input on a navigation app can be migrated into the passenger’s device with the help of FLUID, so that the destination can be easily and safely entered by the passenger while the driver is at the wheel.
FLUID can also support 5G multi-view apps – the latest service that allows sports or games to be viewed from various angles on a single device. With FLUID, the user can watch the event simultaneously from different viewpoints on multiple devices without switching between viewpoints on a single screen.
PhD candidate Sangeun Oh, who is the first author, and his team implemented the prototype of FLUID on the leading open-source mobile operating system, Android, and confirmed that it can successfully deliver the new UX to 20 existing legacy apps.
“This new technology can be applied to next-generation products from South Korean companies such as LG’s dual screen phone and Samsung’s foldable phone and is expected to embolden their competitiveness by giving them a head-start in the global market.” said Professor Shin.
This study will be presented at the 25th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2019) October 21 through 25 in Los Cabos, Mexico. The research was supported by the National Science Foundation (NSF) (CNS-1350883 (CAREER) and CNS-1618531).
Figure 1. Live video streaming and chatting app scenario
Figure 2. Navigation app scenario
Figure 3. 5G multi-view app scenario
Publication: Sangeun Oh, Ahyeon Kim, Sunjae Lee, Kilho Lee, Dae R. Jeong, Steven Y. Ko, and Insik Shin. 2019. FLUID: Flexible User Interface Distribution for Ubiquitous Multi-device Interaction. To be published in Proceedings of the 25th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2019). ACM, New York, NY, USA. Article Number and DOI Name TBD.
Video Material:
https://youtu.be/lGO4GwH4enA
Profile: Prof. Insik Shin, MS, PhD
ishin@kaist.ac.kr
https://cps.kaist.ac.kr/~ishin
Professor
Cyber-Physical Systems (CPS) Lab
School of Computing
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Sangeun Oh, PhD Candidate
ohsang1213@kaist.ac.kr
https://cps.kaist.ac.kr/
PhD Candidate
Cyber-Physical Systems (CPS) Lab
School of Computing
Korea Advanced Institute of Science and Technology (KAIST)
http://kaist.ac.kr Daejeon 34141, Korea
Profile: Prof. Steve Ko, PhD
stevko@buffalo.edu
https://nsr.cse.buffalo.edu/?page_id=272
Associate Professor
Networked Systems Research Group
Department of Computer Science and Engineering
State University of New York at Buffalo
http://www.buffalo.edu/ Buffalo 14260, USA
(END)
2019.07.20 View 41315 -
President Shin Shares Innovation Strategy at Moscow
President Sung-Chul Shin shared the recipe for success for rapid national development through university education during the Island 10-22 Conference held at the Skolov Institute of Science and Technology in Moscow on July 16.
President Shin stressed how urgent it is for higher education to rapidly embrace the new global economic environment brought about by the Fourth Industrial Revolution in his keynote address entitled ‘Roles and Responsibilities of Universities for Rapid National Development’.
The Island 10-22 Conference is a summit co-organized by the National University of Science and Technology MISIS and University of the National Technological Initiative 2035 and supported by the Ministry of Science and Higher Education of the Russian Federation. More than 30 world-renowned experts, presidents of leading technological universities including President Peretz Lavie from the Israel Institute of Technology Technion, President Scott Pulsipher from Western Governors University and specialists in big data participated in the conference as speakers and discussed a diverse spectrum of ideas for making innovations and digital transformations in universities. More than 1,600 participants joined the conference.
During his keynote speech, President Shin explained how Korea has achieved such rapid economic growth over the past half century. He cited the Korean government’s vision and innovation policies as factors leading to Korea’s phenomenal success. KAIST, one of the results of the Korean government’s innovation policy, led the nation to advanced technological breakthroughs in industries such as semiconductors. Such visionary policies and investments in science, technology, and education eventually made the Korea of today possible.
President Shin said that KAIST distinguished itself through its new vision of C3 that fosters intellectual creativity, caring for others, and a challenging mind . Under Vision 2031, a blueprint for becoming a leading global university, President Shin said the KAIST continues to strive for innovations in convergent education,research and entreprenurship.
2019.07.18 View 7848