The only downside of being fully remote is the lack of in-person connection; spontaneous conversations and team bonding just don't happen naturally. That said, it's a pretty minor gripe and honestly comes with the territory when remote work is the trade-off.
It's also a very entrepreneurial, self-driven environment, so if you need a lot of structure or hand-holding to stay motivated, this probably isn't the right fit.