More than one player want to grab a gameobject at the same time, how to solve it?

Hey, the goal is for one player to take a gameobject away from the other player.

How can one player take something from the other player's hand without the first player having to let go?

Currently, both players can grab the object and also take it from the other's hand. The problem is that if the object is grabbed even though the first player doesn't let go, it looks to both players like only they are holding the object.