It has to be either or, you can't have both functioning as your assistant at the same time, so you'll have to make a choice on the matter. Also note that Gemini currently can't interact with your smart home devices, so if you have a lot of those it's probably best to stick with the Google Assistant for...
http://dlvr.it/T7vPJM