Y’all are making this way more complicated than it needs to be.
Wild West
The plugin directory is open to anyone who isn’t actively harmful.
For those users who are looking for guidance…
Compatibility With Current Version
Set a “Compatibility Rating”
- Fully compatible with most current version (V.x.x)
- Compatible with current minor version (V.x)
- Compatible with current Major version (V)
- Unconfirmed compatible
Prioritize listings by rating, only show rating=4 by explicit consent (e.g., “show me all plugins, even if they aren’t compatible”)
If a plug-in dev can’t be arsed to check the plugin with a clean install of the current CP version and update a simple text file, then they should be bumped down the list.
Olympic Ranking
Rather than the common “5 star” ranking system, move to a more granular system (percentage?). Then remove the outliers (as is standard in statistics). So (for example) ignore every review under 10% and over 95%. Eliminate the fanboys and haters from the equation.
Badges
CP needs to make money. Use the plug-in directory to do so.
Develop a clear and well-defined set of criteria for “certification levels”. Bronze means “works with the most current V.x version of CP and the most popular plugins”. Platinum means "works with the most current V.x.x version of CP and has no conflicts with any Badged plugins.
Plugins can pay to be assessed for certification at each level (e.g., platinum, gold, silver, bronze).
Badges would heavily influence search rankings.
Find the right balance of Certified, Approved, and Popular, and you have a valuable listing of plugins.
And a great marketing tool.
And a great source of income.