What is the difference between using 3.5mm or RCA input?

While there is no circuit difference between front AUX and rear RCAs it is possible for the software to add some extra gain when selecting the front AUX compared to rear panel RCA.

This is because some smartphones or portable players do have a low level output, so the assumption is that this input would require more gain.

Beyond this, there should be no tonal difference.