Replacing Gemini with Google Assistant

Please let me know if you have found any known concerns in replacing Gemini with Google Assistant.