It might because your remain members never login into your site yet. That's why they won't appear on your member page. There's only 3 ways to solve the count of members issue
1. By asking your members to verify and logged in into your site or as admin, you can reset their passwords and then login to activate their account one by one (but you may ask for permission to them). I know this will take some effort but we think you can try that way.
2. Try this plugin >> https://buddydev.com/plugins/bp-autologin-on-activation/
3. Use this snippet code
https://gist.github.com/shanebp/b73343e9c9a6509d2bbc47de80c881c1
Paste the snippet on bp-custom.php file (you need to create a new file one) and upload it into wp-content/plugins folder.
Please check your members page, once all members already appear then delete the snippet code.