To turn off the manager view of the Contacts tab, follow the steps below:
Click Access Button
then click HR Admin.
Click Settings, then click Employees.
Turn off the Manager can see employee contact details option.
πNote: It's not possible to only hide the Bank Details. Once you turn the button off, the Contacts tab will be hidden for managers including bank details and contact detail