Server-authoritative Rigidbody movement

Options
Having a problem with it. I have a rigidbody on my player character (just a Cube atm) and it has a player controller / IPlayerState attached to it.

IPlayerState looks like this:

http://prnt.sc/8ryo3o

PlayerCube prefab looks like this:

http://prntscr.com/8ryoiw

In the PlayerController there is this code:

http://prntscr.com/8ryorl

And I am instantiating the PlayerCube on the server + using AssignControl to make the player a controller...

What happens is that when the player uses W, A, D to move it only moves on the server, for the player controlling the cube it just stays there...

Thanks