Benchmarking Action Valuation in Football: From Standardized Evaluation to Systematic Spatio-Temporal Model Design

Submitted

Artur Xarles, Arnau Barrera-Roy, Sergio Escalera, Thomas B. Moeslund, and Albert Clapés

BenchBomb action valuation task

Abstract

Action Valuation (AV) in football aims to assign values to individual player actions reflecting their quality and contribution to team performance, supporting applications in sports analytics. Despite the growing number of AV methods, systematic comparison remains challenging due to limited public datasets and the lack of standardized evaluation protocols. Existing methods are therefore often assessed using different datasets, valuation formulations, and evaluation settings, limiting direct and reproducible comparison. To address this gap, we introduce BenchBomb, an AV benchmark built on StatsBomb Open Data that provides standardized data partitions and a common evaluation protocol for heterogeneous AV methods. Inspired by player-valuation approaches, BenchBomb evaluates action values through their downstream predictive power when aggregated into player- and team-level performance indicators. Using BenchBomb, we systematically analyze AV design choices across four dimensions: valuation framework, supervision design, game-state representation, and model architecture. Our findings show that goal-based supervision outperforms denser proxy outcomes, intermediate credit-assignment horizons provide the best balance for value propagation, and player positional information improves state-value estimation. Based on these findings, we introduce VAST, Valuation of Actions through Systematic Spatio-Temporal design, which combines the empirically supported design choices into a unified AV approach. VAST achieves the strongest downstream performance on BenchBomb, outperforming established methods including xThreat, VAEP, and Atomic-VAEP. Compared with the strongest existing baseline, VAST improves performance on the downstream metrics, reducing Team 1X2 NLL from 1.0081 to 0.9992 and Player 1X2 NLL from 1.0021 to 0.9969. We will publicly release the benchmark code, evaluation pipeline, and VAST implementation upon acceptance.