Sophia v2.0 is now released along with an extensive and open source test suite that can be run against any model. You may view the test suite including its leaderboard at: https://git.cicero.sh/aquila/ha-voice-test-suite/
Over the coming weeks it's expected more larger local LLMs will be added to the leaderboard, but as you can see, Sophia NLU is the clear winner with 98.4% accuracy in 10.1 seconds against 3715 tests. Hopefully frontier models such as Claude Sonnet 5 will be added shortly, but I personally kept getting rate limited when trying, although I'm confident it will get low 90s due to their probabilistic nature with duration of 60 - 90 minutes.
All trials of Sophia have been reset and another 14 days are available again. All lifetime licenses previously given remain exactly that, free lifetime licenses.
Please try Sophia again, you should notice a marked improvement. Would be great to hear your experiences with the latest version by replying below.
Warm regards,
Aquila Labs https://nlu.to/ha/