Invited users only see their custom dashboards
This is normal. Creating a custom dashboard adds a new custom dashboard only under your account. Contacts who are invited to view your account will not see your customized versions in their side panel.
If you want to share a custom dashboard view with others you can use the Share option and send the shared link to others.