I found out how to solve this issue and also fix the issue with the lag of the UI. You have to disable smart devices in all but 1 service. So for example I use Google Home, so I disabled (removed) devices from the services Xiaomi Home and Android S Easter Egg. You can choose these services in the drop-down menu on the top. I only had one device in the Xiaomi Home service, my robot vacuum, and I can still use this in my Google Home section.