Matchmaking system like Overwatch, Valorant, and Leauge of Legends

Options

Working with Host-Client topology, I found my game's system decentralized and hard to think of a way to create matchmaking system that does not require manual room selection. With my limited experience, I am guessing using cloud data service like firebase to do it. but I am never sure. Any tips or instructions?