Deep Soccer Captioning

Cherry-Picked Examples

Vid1_shot.mp4

Generated caption: <player> <team> unleashes a shot, but his effort is poor and floats high over the bar.
Reference caption: <player> <team> unleashes a shot towards the goal, but his effort isn't precise at all and it flies high over the bar.

Vid2_Sub.mp4

Generated caption: <coach> has decided to make a substitution . <player> <team> is replaced by <player> <team> .
Reference caption: <coach> has decided to substitute <player> and he is replaced by <player> <team> .

Vid5_OffTarget.mp4

Generated caption: <player><team> receives a pass and unleashes a shot from the edge of the box, but it goes well wide of the left post.
Reference caption: <player> <team> has a great chance to score from deep inside the box! he finds some space for the shot, but sends it errantly way past the left post. very poor attempt.

Vid6_Offside.mp4

Generated caption: <player> <team> is adjudged offside.
Reference caption: <player> <team> is flagged for offside.

Vid3_RedCard.mp4

Generated caption: "<player> <team> is penalised for a foul . <ref> had a clear sight of players .
Reference caption: <ref> shows a red card with no hesitation. <player> <team> can have an early bath and think about his challenge .

Vid4_YellowCard.mp4

Generated caption: <player> <team> is penalised for a foul. <ref> had a yellow card.
Reference caption: <player> <team> is awarded a yellow card. the referee showed him no mercy.

Vid7_Freekick.mp4

Generated caption: <player> <team> takes the free kick and sends a cross into the box.
Reference caption: <player> <team> is going to send the ball in from the free kick .

Vid8_Corner.mp4

Generated caption: <player> <team> takes the corner but it's cleared.
Reference caption: <player> <team> takes the corner, but the opposition's defence is ready and clears the ball to safety . <team> will have a chance to score from a corner kick.

Soccer Captioning model

Our

Ahmad Hammoudeh

G

Bastein Vanderplaetse

G

Prof. Stéphane Dupont

G


MAIA
Lab

BibTeX

@article{hammoudeh2022Soccer,
title={
Soccer captioning: dataset, transformer-based model, and triple-level evaluation},
author={Hammoudeh, Ahmad and Vanderplaetse, Bastien and Dupont, St{\'e}phane},

journal={Procedia Computer Science},
year={2022},
publisher={Elsevier}
}