Go into your Settings >> Apps menu, find the Duo app listing and open it, then tap on 'Permissions' and make sure Contacts is enabled.
And just to confirm it, go to Settings >> Accounts and open the Duo listing there, Contacts should now be enabled there too.