Some (most) plugins build just fine with the cli. There are some (a few) that rely on features in the current cli and the cloud services are behind implementing the current cli.
Best thing is read the plugin docs and if it doesn’t specifically say it doesn’t support cloud builds, then add the plugin and do a test build.
I keep a generic project preconfigured just for this… add a plugin, build and if that goes okay then write some test code and if that goes okay then move it over to the intended project. Then build, run your test code and make sure you didn’t break anything.