AI-generated sports highlights. Approaches comparison
Published: 2022-02-10 09:27:21

Broadcasters and sports leagues are going out of their way to provide the viewers with the best sporting content they can produce. Given the sheer amount of people regularly tuning in to sporting events, be it on TV or on the field, video content producers take their best shots at making content that catches as many eyes as possible.

And the competition for viewers’ attention is not over after the players leave the field. Now, anyone who can put up a highlight compilation or a game summarization first gets the edge.

So, let’s talk about how media companies do just that — with the help of Artificial Intelligence.

## Here’s how sports highlights are made

When it comes to [generating sports video highlights](https://cognitivemill.com/solutions/sports-highlights/), it’s a manual process for the most part. Sports broadcasters have large teams of editors who produce sports-related content for said broadcasters.

Usually, the process goes like this: the editor gets the footage of the whole game along with the data feed pointing to the memorable events. Then they go on to look through it and cut the clips containing all of the goals, pitches and dunks any sports fan would love along with some drama.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vcky96qncdyiak74z0c1.jpg)

Then the editor compiles the clips into a single sequence, adds graphics, music, and transitions. That can be then posted on social media or broadcasted on TV to draw in more viewers.

That approach poses a serious problem with production efficiency.

## The problem with manual highlights generation

Given the length of sporting events, it takes editors hours to make a single highlight compilation video. Add in the fact that the sports seasons can be tightly packed with events happening back to back — and you have a ton of work on your plate.

On top of that, compilation videos can serve different purposes for the broadcaster, from recapping the best moments on the air or on the internet for those who missed the game to putting them on social media or advertisements for promotional reasons.

So, sometimes there’s a need for several sports video highlights from a single game, which means even more time in front of the screen for editors. 

The thing is that the editors don’t really have a lot of time to work with: with media, the first one to put out the content usually gets the attention. The quality of said clips, though very important, is rendered non-relevant if the clips are late.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8g7ll8i5v13d2dznhw0q.jpg)

The race against the clock has only gotten rougher over the years: now, any fan can pull out their smartphone and record the back and forth between the player and a referee, then post it immediately, and go viral in minutes.

So, we have to work as quickly as we can. And that is where Artificial intelligence steps in.

## Automatic sports highlights generation

To speed up the process of sports content generation, media providers are looking into ways to have AI analyze the game footage and pick out the highlight-worthy moments automatically.

Responding to the emerging demand, tech companies are adopting AI and ML algorithms to pinpoint the best moments of sports.

Now, the competition is on for the best approach to video content analysis. Let’s see what those approaches are.

### Audio analysis

That approach is not all about identifying whatever is happening on the field, but how the audience reacts to it. 

By analyzing the sound, the algorithm picks up on anything out of the ordinary, like an audience cheering, or a referee arguing with a player — and chooses the respective clips to be included in the compilation.

But that approach may not be ideal for sports with less vocal audiences — for example, there are no cheering crowds during a golf game.

Speaking about the crowds — sometimes there are none even when they are supposed to be. During the COVID-related lockdowns, the sports events were held with now spectators.

And even when there are crowds, some of the subtle moments like the coach talking to the team or mascots doing their mascot things may not get included in the AI highlight.

### Point selection

Another approach to finding the best moments of the sporting event is to have visual recognition APIs to detect the features common for memorable moments: fist-bumps, high-fives, raised hands, or fans standing up.

Backed by data analytics, the algorithm determines the required length of the clips to cut, edits out the unnecessary parts, and puts the video together.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6ztpx1hiw8pfw2fgn9z7.jpg)

Keeping in mind the abundance or compilations types a media company might need, that approach leaves a lot of the content out.

If a broadcaster wants to create a game summarization video — they would have to train the AI from scratch. A mascot dance compilation? You better have time to let the algorithm learn what it is.

### Scene-level video analysis

Knowing the flaws of mentioned approaches, we set out to build a solution that could pinpoint highlight-worthy moments in video content just as quickly and accurately, but also could do so without preliminary training and additional data feeds.

[AIHunters](https://aihunters.com/) team relied on cognitive computing technology to achieve the human-like perception of video content. This way, the algorithm can analyze each scene of the video and extract all of the information required for creating highlights.

It needs no external data feeds or audio analysis. A system powered by cognitive computing can decompose the video and analyze the game dynamics, excitement levels, and the context of the event, imitating the human brain’s perception. 

We also apply motion analysis, probabilistic AI, and math modeling to enable the solution to precisely identify the most important parts of the footage.

{% vimeo https://vimeo.com/665180254 [width] [height] %}

In addition to that, a more complex algorithm can be customized. It requires no extensive training to analyze the footage for different types of compilation videos, such as: 

- Highlight videos for any type of sport;
- Trailers for tournaments;
- Game summarization clips.

## Bottom line

Everyone working in the media industry knows the rules: the early bird gets the worm.

That applies not only to covering news stories, but to the content strategy for broadcasting companies, sports leagues, and TV channels. Delivering high-quality content as quickly as possible to the viewers is a top priority here.

Keeping that in mind, media companies are turning to technology to find a way to speed up the process while retaining the accuracy of a human brain when it comes to creating sports highlights.

Among many approaches to the problem, the one which requires less preparation proves to be the most effective. Because it does not matter if the AI trims down the editing time but spends it training for the next set of clips.

In that regard, cognitive computing might be the way to go, since it can work with any content with no preparation while keeping the same accuracy at detecting highlight-worthy moments.