2022-11-25 13:34:00

Researchers from Gwangju Institute of Science and Technology Develop an Intelligent Observer for Esports

Logo PR Newswire
PR Newswire

It utilizes an object detection algorithm that learns human spectating data to find engaging viewports

GWANGJU, South Korea, Nov. 25, 2022 /PRNewswire/ -- Human game observers are a vital part of the Esports industry. They use extensive domain knowledge to decide what to show to the spectators. However, they may miss important events, necessitating the need for automatic observers. Researchers from South Korea have recently proposed a framework that utilizes an object detection method, Mask R-CNN, and human observational data to find the 'Region of Common Interest' in StarCraft—a real-time strategy game.

Esports, already a billion-dollar industry, is growing, partly because of human game observers. They control the camera movement and show spectators the most engaging portions of the game screen. However, these observers might miss significant events occurring concurrently across multiple screens. They are also difficult to afford in small tournaments. Consequently, the demand for automatic observers has grown. Artificial observing methods can either be rule-based or learning-based. Both of them predefine events and their importance, necessitating extensive domain knowledge. Moreover, they cannot capture undefined events or discern changes in the significance of the events.

Recently, researchers from South Korea, led by Dr. Kyung-Jong Kim, Associate Professor in Gwangju Institute of Science and Technology, have proposed an approach to overcome these problems. "We have created an automatic observer using object detection algorithm, Mask R-CNN, to learn human spectating data," explains Dr. Kim. Their findings were made available online on 10 October 2022 and published in Volume 213 Part B of Expert Systems with Applications journal.

The novelty lies in defining the object as the two-dimensional spatial area viewed by the spectator. In contrast, conventional object detection treats a single unit, for instance, a worker or a building, as the object. In this study, the researchers first collected StarCraft in-game human observation data from 25 participants. Next, the viewports—areas viewed by the spectator—were identified and labeled as "one." The rest of the screen was filled with "zeroes." While the in-game features are used as input data, the human observations constituted the target information.

The researchers then fed the data into the convolution neural network (CNN), which learnt the patterns of the viewports to find the "region of common interest" (ROCI)—the most exciting area for the spectators to watch. They then compared the ROCI Mask R-CNN approach with other existing methods quantitatively and qualitatively. The former evaluation showed that CNN's predicted viewports were similar to the collected human observational data. Additionally, the ROCI-based method outperformed others in the long run during the generalization test, which involved different matchup races, starting locations, and playing maps. The proposed observer was able to capture the scenes of interest to humans. In contrast, it could not be done by behavior cloning—an imitation learning technique.

Dr. Kim points out the future applications of their work. "The framework can be applied to other games representing some of the overall game state, not only StarCraft. As services such as multi-screen transmission continue to grow in Esports, the proposed automatic observer will play a role in these deliverables. It will also be actively used in additional content developed in the future."

DOI: https://doi.org/10.1016/j.eswa.2022.118979

Title of original paper: Learning to automatically spectate games for Esports using object detection mechanism

Journal: Expert Systems with Applications

*Corresponding author's email: kjkim@gist.ac.kr

About the Gwangju Institute of Science and Technology (GIST)
Website: http://www.gist.ac.kr/

Chang Sung Kang
82 62 715 6253

Cision View original content to download multimedia:https://www.prnewswire.com/news-releases/researchers-from-gwangju-institute-of-science-and-technology-develop-an-intelligent-observer-for-esports-301686149.html

SOURCE Gwangju Institute of Science and Technology

Logo Benzinga
Business / FinanceBy Pr Newswire2022-11-25 13:34:00
It utilizes an object detection algorithm that learns human spectating data to find engaging viewports GWANGJU, South Korea, Nov. 25, 2022 /PRNewswire/ --...

Logo PR Newswire
The value of esports is especially prevalent at the post-secondary level for student development, recruitment, and retention. TORONTO, Nov. 24, 2022...

Logo Benzinga
Business / FinanceBy Pr Newswire2022-11-24 21:45:00
The value of esports is especially prevalent at the post-secondary level for student development, recruitment, and retention. TORONTO, Nov. 24, 2022...

Logo Daily Star
FootballBy Harry Brent2022-11-25 08:55:02
Talk about 'looking suspicious'. A couple of sly-eyed Mexico fans were caught sneaking booze into the stadium ahead of their country's clash with Poland on...

Logo Goal
FootballBy Goal2022-11-24 14:48:31
This page contains affiliate links. When you subscribe through the links provided, we may earn a commission. For the first time in several years, the US mens...

Logo PR Newswire
TechnologyPress Release2022-11-25 13:30:00
NEW YORK, Nov. 25, 2022 /PRNewswire/ -- Color Star Technology Co., Ltd. (Nasdaq: ADD) ("Color Star" or the "Company"), an entertainment technology company...

Logo U.S. News & World Report
PoliticsBy Associated Press2022-11-24 18:37:57
DOHA, Qatar (AP) The World Cup is drawing record viewership to Spanish-language broadcasts on Telemundo and Peacock, with Mexicos match against Poland giving...

Logo Goal
FootballBy Mitchell Wilks2022-11-24 15:58:00
World Cup viewing figures down in Germany 9 million people watched Japan defeat Down from 25m average in 2018 WHAT HAPPENED? As Germany kicked off their 2022...

Logo 90min
FootballBy 90min2022-11-24 18:45:58
How to watch Japan vs Costa Rica in Group E of the 2022 World Cup on TV and live streaming services.

Logo The Independent
FootballBy Kieran Jackson2022-11-24 16:30:06
Netherlands are targeting two wins out of two against an Ecuador side who surprised many with their convincing performance against Qatar in the first game of...

Logo Daily Mail
FootballBy Olivia Devereux Evans2022-11-24 12:01:04
Mexican fans tried to sneak booze into the Qatar World Cup stadium in a flask disguised as binoculars- but the hapless supporters were caught and it was...

Logo Livescore
FootballBy Dan Mc Carthy2022-11-24 14:36:17
1998-2022 LiveScore Careers Mobile Advertise Faq Contact News Publishers Privacy Notice Cookie Policy Terms of Use Corporate Desktop View

Logo NBC Sports
FootballBy Joe Prince Wright2022-11-24 21:00:00
South Korea and Ghana collide in Group H with both teams earmarking this as a must-win game in an incredibly tight group. STREAM LIVE SOUTH KOREA v GHANA...

Logo The Telegraph
FootballBy Danny Boyle2022-11-25 04:42:00
Gareth Bale has urged teachers in Wales to let children watch a World Cup mini history lesson in Qatar. Wales' second game of the 2022 World Cup kicks off at...

Logo PR Newswire
TechnologyPress Release2022-11-23 19:28:00
LOS ANGELES, Nov. 23, 2022 /PRNewswire/ -- Recently, LiveMe released the Super Soccer Game as part of World Cup celebrations for LiveMe fans. Super Soccer is...

Logo The New York Times
FootballBy John Branch2022-11-24 14:53:23
A shipping container stadium, but better visit soon: Its coming down after the tournament. Qatar has eight stadiums for the World Cup. One is unlike all the...

Logo BBC
Football2022-11-24 22:12:03
> Hello, my name is Jrgen and I'm writing a daily email newsletter from Qatar for the BBC during this World Cup. This is a tournament that really means a...

SportBy Espn2022-11-25 12:30:08
Week 13 of the college football season features many eye-catching uniforms from several schools. Editor's Picks What to know about the new EA Sports college...

Logo 90min
FootballBy 90min2022-11-24 18:30:30
How to watch Argentina vs Mexico on TV and live streaming platforms.

Logo The Independent
FootballBy Alex Pattle2022-11-24 16:29:16
After Qatars underwhelming start to the 2022 World Cup, the hosts will seek to respond positively here with a win against Senegal in Group A. Qatar were 2-0...