Consider finite group $G$ , symmetric set of its elements $S$, construct a Cayley graph.
Consider $d(g)$ - word metric or distance on the Cayley graph from identity to $g$.
As any function on a group it can be decomposed into "Fourier" basis coming from the irreducible representations. See formula below. It is the very standard fact that decomposition of the representations like regular representation - is generalization of the Fourier decomposition. Fourier decompositions are particular cases for the abelian groups. See e.g. wikipedia.
That basis does not depend on $S$ and while $d(g)$ obviously depends, that decomposition can be kind of simple for $S$ and complicated for the other, nevertheless , we can ask:
Question: are there some known properties or expectations that such decomposition can be a good one ? Can one estimate the reside term if we take only some irreps ? Or more generally are there some techniques that relate some knowledge on the representation theory of a given group to question on its Cayley graph (metric approximation , diameter estimation, growth, etc. )?
Results by J.Swan (see below) suggests that sometimes Fourier decomposition can be sparse, i.e. only few are non-zero for some approximations of the word metrics. In general representation theory is quite related to Cayley graphs studies see e.g. Tao's blog: https://terrytao.wordpress.com/2011/12/16/254b-notes-3-quasirandom-groups-expansion-and-selbergs-316-theorem/
Motivation comes from the paper, where authors search by machine learning methods the function using such decomposition. More precisely - one uses such an ansatz and coefficients are found by gradient descent technique. They argue there approach is reasonably effective, so I wonder is there any theoretical basis which might shed light on such an approach ?
"Fourier Bases for Solving Permutation Puzzles" (Horace Pan, Risi Kondor) https://proceedings.mlr.press/v130/pan21a.html
Reminder. The Fourier transform and its inverse over the groups looks like that. Pay attention - coefficients are MATRICES, and so the inverse transform contains "Tr".
Interesting facts. "Harmonic Analysis and Resynthesis of Sliding-Tile Puzzle Heuristics" 2017 Jerry Swan - interesting paper observed sparsity of Fourier coefs for Hamming/Manhatten function on 15-puzzle. https://ieeexplore.ieee.org/abstract/document/7969355
These is not "word/Cayley" metric , but these are standard approximations, which are always used.
PS
Some my colleagues and me are thinking to apply machine learning methods to similar task in group theory - if any one interested - would be great to keep in touch !