Go to the corresponding field in the custom record.
Then Under the Access Subtab, We can set the Access Levels Default Search or Reporting access permission as None. Then under the Roles subtab we can select the particular roles and can assign the permission to them for this field
