A spectral description of the spin Ruijsenaars-Schneider system