People View

We don't see the proper people in the proper groups under People. We do when the view is set to User Management and would like to see them match. It's because the default under People is 100 - can the default instead be All? Is it 100 due to performance load time/issues?