Europa Universalis V

analyzed 2026-08-18 · sample of 572 English reviews across the whole review history

Gameplay is the most discussed aspect, with 42% of sampled reviews mentioning it, and the tone there is largely positive—players describe the game as "very complex and strategic" and note that "core mechanics feel very good." The same complexity draws criticism elsewhere: the learning curve is steep, with one player saying you "need at least 50 hours just to grasp the basics," and the pacing is called out for taking "too long to reach the fun part of the game." Players also consistently praise the addictiveness, with every mention of it being positive, including "hard to actually step away." The strongest recurring complaints center on the UI, balance, and AI behavior. The UI is described as "UI on top of UI and numbers on top of numbers," and balance draws criticism for mechanics that are "poorly explained or unbalanced." AI behavior is faulted for things like "subjects being able to make peace by themselves when they have low loyalty" and for not declaring wars often enough. Bugs and stability are also frequent sore points, with players reporting "a lot of bugs, and every patch new bugs get introduced" and "potentially save-ruining bugs." Developer conduct is criticized for ignoring "the most critical demands of the players," and some players tie this to the DLC model, hoping "in 2 years with a dlc or 2 the game will be good." Opinion splits appear on content amount, which is nearly evenly divided between positive and negative mentions, and on updates, which lean positive. Diplomacy and economy come up as recurring themes in player discussion.

numbers checked against this report's stored data · quotes copied verbatim from reviews · plain text is the language model's own wording

Aspects

share of sample, axis to 50% · ± is the sampling uncertainty around each share

  • positive
  • mixed / neutral
  • negative
  • gameplay

    140 positive · 67 negative · 32 mixed · 1 neutral

    • Great game, very complex and strategic.
      positive · Nov 10, 2025 · review 208889338
    • This game feels like a labor of love, the core mechanics feel very good.
      positive · Nov 10, 2025 · review 208889493
    • I've only played through Flanders to the age of discovery but it's a lot of fun.
      positive · Nov 10, 2025 · review 208890016
  • content amount

    37 positive · 38 negative · 1 mixed · 0 neutral

    • And the base game is fun all by itself, so if you don't want to pick up the additions over time, then don't - you'll still have a good time.
      positive · Nov 10, 2025 · review 208887161
    • also amount of buildings is great
      positive · Nov 10, 2025 · review 208888500
    • I genuinely think this game is a work of art, from the aesthetics of how beautiful the map modes are (especially the 3d map mode), from the historical accuracy of the game, to the sheer scope and scale of what the game offers and the massively deep and nuanced systems like the economy and trade.
      positive · Nov 10, 2025 · review 208890498
  • bugs

    3 positive · 69 negative · 1 mixed · 0 neutral

    • The game is still very disappointing, especially the team’s decision to release a DLC for a country instead of focusing on the bugs reported by the community.
      negative · Nov 10, 2025 · review 208888501
    • It's almost like PDX choose to forget all their previous work on EU4 and just copy paste a bunch of broken, buggy mechanics from their other IP's.
      negative · Nov 10, 2025 · review 208888656
    • sometimes taking weeks now to fix even one completetely game breaking bug.
      negative · Nov 10, 2025 · review 208888849
  • updates

    39 positive · 27 negative · 2 mixed · 1 neutral

    • However, the dev team has been working on these things and the community is building tutorials, rankings, guides, and other resources to help players learn.
      positive · Nov 10, 2025 · review 208893643
    • The game it self have quite a bit bugs however, bugs will go away by upmonig patches.
      positive · Nov 10, 2025 · review 208894138
    • This is a good game now, and it'll be a great game with some more updates!
      positive · Nov 10, 2025 · review 208894710
  • ui

    1 positive · 56 negative · 3 mixed · 1 neutral

    • Technical side: UI is bad.
      negative · Nov 10, 2025 · review 208887869
    • They want to give so much information with UI on top of UI and numbers on top of numbers, but none of them mean anything.
      negative · Nov 10, 2025 · review 208890884
    • - The UI stays a big negative for me even after they touched it up a little, i miss the old right click that showed all the diplomatic relations and all the info of a …
      negative · Nov 10, 2025 · review 208891548
  • learning curve

    17 positive · 31 negative · 1 mixed · 6 neutral

    • PUT THIS GAME ON MAC, but also so far pre good, does take a while to learn tho
      negative · Nov 10, 2025 · review 208892466
    • Even as an experienced Paradox player, you’ll need at least 50 hours just to grasp the basics.
      negative · Nov 10, 2025 · review 208894092
    • The mix works, but at launch it's very overwhelming.
      negative · Nov 10, 2025 · review 208896000
  • balance

    1 positive · 52 negative · 1 mixed · 0 neutral

    • Giving 0 money due to offer being too high and demand staying flat ish even before black death.
      negative · Nov 10, 2025 · review 208889027
    • Some mechanics are poorly explained or unbalanced.
      negative · Nov 10, 2025 · review 208893643
    • I still find the vanilla version very unbalanced and unpleasing.
      negative · Nov 10, 2025 · review 208897033
  • performance

    8 positive · 35 negative · 0 mixed · 2 neutral

    • Alright, so i had some pretty bad first hand impressions, especially bout lack of optimisation and UI, seriously considered to do a refund.
      negative · Nov 10, 2025 · review 208892274
    • The game is so badly optimised, that I don't even know where to start.
      negative · Nov 10, 2025 · review 208896201
    • Only real complaint is the load times.
      negative · Nov 10, 2025 · review 208898086
  • ai behavior

    1 positive · 39 negative · 1 mixed · 0 neutral

    • Reaching the colonial stage with a centralisation focus feels like a punishment, and subjects being able to make peace by themselves when they have low loyalty—even if you joined the war—feels like a bug that the developers are simply ignoring.
      negative · Nov 10, 2025 · review 208888501
    • ai has some issues and UI could be better.
      negative · Nov 10, 2025 · review 208892344
    • The AI doesn't declare wars all that often, especially not on players.
      negative · Nov 10, 2025 · review 208898653
  • stability

    10 positive · 23 negative · 0 mixed · 0 neutral

    • Stuff happens that shouldn't happen and bricks your save, the game decides to white peace out of nowhere with no information or tooltip or anything at all.
      negative · Nov 10, 2025 · review 208890884
    • Might also be worth waiting for patches for lower end machines, seem to be a lot of crash issues.
      negative · Nov 10, 2025 · review 208898086
    • Game released broken but with a really promising potential.
      negative · Nov 10, 2025 · review 208905145
see more
  • developer conduct

    6 positive · 24 negative · 0 mixed · 0 neutral

    • They completely ignore the most critical demands of the players, utterly lost in their own clown show.
      negative · Nov 10, 2025 · review 208890565
    • They flip that switch and call it an update or patch.
      negative · Nov 10, 2025 · review 208901307
    • Every update has made the game worse because of bugs, arbitrary stupid changes or both at the same time, no one at Tinto is capable of producing a good game and Eu5 proves it.
      negative · Nov 10, 2025 · review 208905145
  • dlc

    12 positive · 16 negative · 0 mixed · 1 neutral

    • The game is still very disappointing, especially the team’s decision to release a DLC for a country instead of focusing on the bugs reported by the community.
      negative · Nov 10, 2025 · review 208888501
    • I'm tired of buggy Paradox games and their DLC slop business model.
      negative · Nov 10, 2025 · review 208889489
    • Hopefully in 2 years with a dlc or 2 the game will be good, but as it stands it just isn't.
      negative · Nov 10, 2025 · review 208892018
  • addictiveness

    23 positive · 0 negative · 0 mixed · 0 neutral

    • Crusader Kings, Victoria, and Europa Universalis had the perfect baby, and it's incredibly addictive.
      positive · Nov 10, 2025 · review 208892953
    • I think this is the game that will consume my life
      positive · Nov 10, 2025 · review 208897419
    • I can't stop
      positive · Nov 10, 2025 · review 208907462
  • price value

    8 positive · 12 negative · 0 mixed · 2 neutral

    • Actually unfun dont buy not worth 60 dollars
      negative · Nov 10, 2025 · review 208910941
    • Blows sadly, won't be playable for years and they will charge $400 to be where eu4 was 10 years ago.
      negative · Nov 10, 2025 · review 208919586
    • It's got potential definitely and I had some fun but I'm not sure if it deserves a recommendation at this stage with such price point.
      negative · Nov 24, 2025 · review 210205233
  • quest design

    2 positive · 18 negative · 0 mixed · 0 neutral

    • Bring back mission trees
      negative · Nov 10, 2025 · review 208900470
    • ), like victoria 3, even today it misses events and historical flavor.
      negative · Nov 24, 2025 · review 210199973
    • The major events like the Black Death, Hundred Years of War etc, it's fun and challenging at first but then again there aren't much follow-ups, the historical events are also seriously lacking even for those popular starting countries, if I compared with CK / Stellaris.
      negative · Nov 24, 2025 · review 210205233
  • progression

    7 positive · 12 negative · 0 mixed · 0 neutral

    • We'll still have challenges like rebels, but the game offers no way to deal with them other than slow integration, and integration is SLOW.
      negative · Nov 10, 2025 · review 208895406
    • Also let us get achievements outside of Ironman.
      negative · Nov 10, 2025 · review 208898836
    • … hours long, there's lots of depth but most of the features you can and (should) ignore/automate as after replacing your cabinet members for the 100th time in a playthrough it starts to become tedious, or sending out an explorer to the 200th tile on the map by clicking through 4 different menus.
      negative · Nov 10, 2025 · review 208916653
  • player choice

    8 positive · 10 negative · 0 mixed · 0 neutral

    • This game is a perfect example of the illusion of decision.
      negative · Nov 10, 2025 · review 208890884
    • This does somewhat boil down to "build the most profitable / necessary things" on a repeating cycle, so whilst you often have a lot to do, there tends to be either a obvious choice, or the choice you make is fairly inconsequential to the overall strength of your nation.
      negative · Nov 10, 2025 · review 208895298
    • All the mechanics and all the complexity cumulate to nothing if the interaction with them are not meaningful.
      negative · Dec 01, 2025 · review 212323571
  • pacing

    2 positive · 15 negative · 0 mixed · 0 neutral

    • However, the pace of the game is significantly slowed down.
      negative · Nov 10, 2025 · review 208895406
    • Once you get past the black death slog it gets really fun.
      negative · Nov 10, 2025 · review 208896203
    • My goodness, this game is slow-paced.
      negative · Nov 10, 2025 · review 208898836
  • combat

    6 positive · 10 negative · 0 mixed · 0 neutral

    • Mainly PUs, some strange battle dev decisions and balance.
      negative · Nov 24, 2025 · review 210201329
    • It's currently (up to 1.0.7) to keep spamming levies that turn wars in a whack-a-mole mini-game.
      negative · Dec 01, 2025 · review 212323571
    • Battle ai is even worse.
      negative · Dec 01, 2025 · review 212330555
  • difficulty

    8 positive · 7 negative · 0 mixed · 0 neutral

    • It’s brutally punishing!
      positive · Nov 10, 2025 · review 208894092
    • It's very stratetigic and the game is fighting with you :))) good game Paradox!
      positive · Nov 10, 2025 · review 208904310
    • ---{ Difficulty }---
      positive · Nov 10, 2025 · review 208905898
  • game length

    5 positive · 9 negative · 1 mixed · 0 neutral

    • Even with automation and 5 speed a century takes about 3 hours.
      negative · Nov 10, 2025 · review 208898836
    • be ready to spend 50 hours just to reach the year 1450.
      negative · Nov 10, 2025 · review 208905339
    • The game is really great as always, but would be nice to play with some years back like since X century till the 19th or something.
      negative · Nov 10, 2025 · review 208917039
  • replayability

    8 positive · 4 negative · 0 mixed · 0 neutral

    • Extremely deep mechanics, high variability, huge replayability.
      positive · Nov 10, 2025 · review 208891961
    • I can tell that this will be another 1000+ hours game for me.
      positive · Nov 10, 2025 · review 208893643
    • Time to drop another 2k hours.
      positive · Nov 10, 2025 · review 208901293
  • realism

    6 positive · 5 negative · 0 mixed · 0 neutral

    • Diseases are tough :( but historical accurate.
      positive · Nov 10, 2025 · review 208890091
    • I genuinely think this game is a work of art, from the aesthetics of how beautiful the map modes are (especially the 3d map mode), from the historical accuracy of the game, to the sheer scope and scale of what the game offers and the massively deep and nuanced systems like the economy and trade.
      positive · Nov 10, 2025 · review 208890498
    • Once they actually fix it, will likely be the best country simulation game on the market.
      positive · Dec 01, 2025 · review 212322267
  • graphics

    7 positive · 2 negative · 0 mixed · 0 neutral

    • Some bugs here and there because it is newly released, but extremely deep economic system and complexity, great graphics.
      positive · Nov 10, 2025 · review 208893645
    • ☑ Good
      positive · Nov 10, 2025 · review 208905898
    • I love the idea, the new mechanics, map, graphics, I love it almost all.
      positive · Nov 10, 2025 · review 208905948
  • mods

    6 positive · 2 negative · 0 mixed · 0 neutral

    • This game is absolutely worth every penny and I can’t wait to see all the amazing mods that are coming!
      positive · Nov 10, 2025 · review 208889925
    • Once i started playing a shattered Europa mod version of it then the game felt alot more complete.
      positive · Nov 10, 2025 · review 208897033
    • still needs some polish but mods come out and make stuff better
      positive · Nov 17, 2025 · review 209499235
  • characters

    4 positive · 3 negative · 0 mixed · 0 neutral

    • I also really like having a royal line similar to the Crusader Kings series, without going too far into it.
      positive · Nov 10, 2025 · review 208902128
    • Another thing I love is how you really get attached to your nations, some of the events for Tier 1 really allows you to roleplay(which they took inspiration from CK3) like giving your heir the …
      positive · Nov 10, 2025 · review 208903647
    • + I like that you see family trees now and newborn don't start with maxed stats which always tickled me
      positive · Nov 10, 2025 · review 208917526
  • lore

    4 positive · 3 negative · 0 mixed · 0 neutral

    • I start a game as Portugal and the first thing I see is a wall of text describing the exact historical situation I'm in as Portugal in 1337, when the game starts.
      positive · Nov 10, 2025 · review 208890498
    • ☑ Some lore
      positive · Nov 10, 2025 · review 208905898
    • -Religions have flavor on release, something EU4 completely lacked
      positive · Dec 22, 2025 · review 213951696
  • world

    4 positive · 3 negative · 0 mixed · 0 neutral

    • The world being simulated here is large and impressive.
      positive · Nov 10, 2025 · review 208904589
    • Deep complex world simulator.
      positive · Nov 10, 2025 · review 208914918
    • … you commit more than just a few days and weeks to understanding its systems, an ever deepening web of mechanisms reveal itself, making the world feel increasingly alive—something many other titles in the genre attempt to achieve through mechanical bloat rather than organic interconnectedness.
      positive · Dec 15, 2025 · review 213378972
  • music

    4 positive · 2 negative · 0 mixed · 0 neutral

    • More music would be nice but what we have is FANTASTIC
      positive · Nov 17, 2025 · review 209504481
    • I guess the music is on point probably because it has nothing to do with the publisher or the core dev team.
      positive · Dec 01, 2025 · review 212350286
    • - The visuals are nice and the soundtrack is awesome (Pain Is Salvation might be the best PDX track of all time – well done, Håkan Glänte).
      positive · Dec 29, 2025 · review 214585356
  • platform access

    2 positive · 4 negative · 0 mixed · 0 neutral

    • PUT THIS GAME ON MAC, but also so far pre good, does take a while to learn tho
      negative · Nov 10, 2025 · review 208892466
    • I'd like to finish my first play through, but it is broken now and they disabled rollbacks.
      negative · Nov 17, 2025 · review 209495889
    • Also every new patch since release fixes one thing while breaking two others, there are so many potentially save-ruining bugs even a month post-release and Paradox won't even let you rollback to a more stable version.
      negative · Nov 17, 2025 · review 209504578
  • art style

    2 positive · 3 negative · 0 mixed · 0 neutral

    • THE LOADING SCREENS ARE SO OBVIOUSLY AI GENERATED IT MAKES MY BLOOD BOIL!
      negative · Nov 10, 2025 · review 208917654
    • Art style - This is a personal thing but the game feel "corporate and sterilized" with overall design and art style with none of the flourish of eu4, also why on earth do we have a character portrait system?
      negative · Dec 08, 2025 · review 212877621
    • I can't stand the UI (which I'm forced to look at 99% of the time), the character portraits/character art makes me want to puke, and the armies on the map look so.
      negative · Feb 02, 2026 · review 217446095
  • build variety

    0 positive · 5 negative · 0 mixed · 0 neutral

    • EU5 has nothing original, nothing new ( as far as gameplay) and every single country is exactly the same as all the ohers, no variations, no unique goverment mechanics, zero flavour.
      negative · Nov 10, 2025 · review 208888656
    • There is very little variation in nations, whether it be with events, ideas, government mechanics, lack of missions, etc.
      negative · Nov 10, 2025 · review 208905063
    • Every nation is basically the same.
      negative · Mar 23, 2026 · review 221518883
  • story

    1 positive · 4 negative · 0 mixed · 0 neutral

    • - without historic knowledge, you might get surprised a few times when your country breaks apart without warning
      negative · Nov 10, 2025 · review 208917526
    • Some historical railroading wouldn’t hurt.
      negative · Dec 01, 2025 · review 212334096
    • 10 the game experience is completely ruined, the AI is supper aggressive and the game is reduced to large nations constantly hammering the small ones, all the historic events went out of the window, the HRE is dysfunctional - Bohemia eats the east, and France - the west.
      negative · Dec 22, 2025 · review 213930187

Emergent themes unvalidated

topics reviewers bring up that are not on the validated list; raw counts only, no error bars

  • diplomacy 5
  • economy 5

Review timeline

weekly peak 9,856 reviews · all languages

review volume 5,000 0 positive review share 100% 50% 0% 2026 week of 04 Nov 2025 · 9,856 reviews (7,485 up · 2,371 down) · 76% positive week of 11 Nov 2025 · 2,593 reviews (2,030 up · 563 down) · 78% positive week of 18 Nov 2025 · 1,632 reviews (1,215 up · 417 down) · 74% positive week of 25 Nov 2025 · 3,643 reviews (3,202 up · 441 down) · 88% positive week of 02 Dec 2025 · 724 reviews (472 up · 252 down) · 65% positive week of 09 Dec 2025 · 451 reviews (274 up · 177 down) · 61% positive week of 16 Dec 2025 · 511 reviews (263 up · 248 down) · 51% positive week of 23 Dec 2025 · 340 reviews (181 up · 159 down) · 53% positive week of 30 Dec 2025 · 386 reviews (188 up · 198 down) · 49% positive week of 06 Jan 2026 · 323 reviews (124 up · 199 down) · 38% positive week of 13 Jan 2026 · 266 reviews (122 up · 144 down) · 46% positive week of 20 Jan 2026 · 275 reviews (120 up · 155 down) · 44% positive week of 27 Jan 2026 · 186 reviews (90 up · 96 down) · 48% positive week of 03 Feb 2026 · 239 reviews (126 up · 113 down) · 53% positive week of 10 Feb 2026 · 178 reviews (75 up · 103 down) · 42% positive week of 17 Feb 2026 · 189 reviews (86 up · 103 down) · 46% positive week of 24 Feb 2026 · 144 reviews (68 up · 76 down) · 47% positive week of 03 Mar 2026 · 181 reviews (79 up · 102 down) · 44% positive week of 10 Mar 2026 · 119 reviews (59 up · 60 down) · 50% positive week of 17 Mar 2026 · 152 reviews (76 up · 76 down) · 50% positive week of 24 Mar 2026 · 153 reviews (73 up · 80 down) · 48% positive week of 31 Mar 2026 · 112 reviews (51 up · 61 down) · 46% positive week of 07 Apr 2026 · 88 reviews (36 up · 52 down) · 41% positive week of 14 Apr 2026 · 90 reviews (46 up · 44 down) · 51% positive week of 21 Apr 2026 · 107 reviews (55 up · 52 down) · 51% positive week of 28 Apr 2026 · 113 reviews (57 up · 56 down) · 50% positive week of 05 May 2026 · 359 reviews (136 up · 223 down) · 38% positive week of 12 May 2026 · 319 reviews (89 up · 230 down) · 28% positive week of 19 May 2026 · 305 reviews (89 up · 216 down) · 29% positive week of 26 May 2026 · 224 reviews (57 up · 167 down) · 25% positive week of 02 Jun 2026 · 197 reviews (57 up · 140 down) · 29% positive week of 09 Jun 2026 · 159 reviews (57 up · 102 down) · 36% positive week of 16 Jun 2026 · 134 reviews (41 up · 93 down) · 31% positive week of 23 Jun 2026 · 139 reviews (56 up · 83 down) · 40% positive week of 30 Jun 2026 · 131 reviews (48 up · 83 down) · 37% positive week of 07 Jul 2026 · 163 reviews (76 up · 87 down) · 47% positive week of 14 Jul 2026 · 130 reviews (50 up · 80 down) · 38% positive week of 21 Jul 2026 · 110 reviews (53 up · 57 down) · 48% positive week of 28 Jul 2026 · 88 reviews (39 up · 49 down) · 44% positive week of 04 Aug 2026 · 107 reviews (58 up · 49 down) · 54% positive week of 11 Aug 2026 · 82 reviews (50 up · 32 down) · 61% positive week of 18 Aug 2026 · 6 reviews (2 up · 4 down) · 33% positive

weekly share rated positive · 50% reference · weeks with <5 reviews faded

the timeline as a table
Reviews per week, all languages; weeks with no reviews are left out.
week reviews up down positive note
week of 04 Nov 2025 9,856 7,485 2,371 76%
week of 11 Nov 2025 2,593 2,030 563 78%
week of 18 Nov 2025 1,632 1,215 417 74%
week of 25 Nov 2025 3,643 3,202 441 88%
week of 02 Dec 2025 724 472 252 65%
week of 09 Dec 2025 451 274 177 61%
week of 16 Dec 2025 511 263 248 51%
week of 23 Dec 2025 340 181 159 53%
week of 30 Dec 2025 386 188 198 49%
week of 06 Jan 2026 323 124 199 38%
week of 13 Jan 2026 266 122 144 46%
week of 20 Jan 2026 275 120 155 44%
week of 27 Jan 2026 186 90 96 48%
week of 03 Feb 2026 239 126 113 53%
week of 10 Feb 2026 178 75 103 42%
week of 17 Feb 2026 189 86 103 46%
week of 24 Feb 2026 144 68 76 47%
week of 03 Mar 2026 181 79 102 44%
week of 10 Mar 2026 119 59 60 50%
week of 17 Mar 2026 152 76 76 50%
week of 24 Mar 2026 153 73 80 48%
week of 31 Mar 2026 112 51 61 46%
week of 07 Apr 2026 88 36 52 41%
week of 14 Apr 2026 90 46 44 51%
week of 21 Apr 2026 107 55 52 51%
week of 28 Apr 2026 113 57 56 50%
week of 05 May 2026 359 136 223 38%
week of 12 May 2026 319 89 230 28%
week of 19 May 2026 305 89 216 29%
week of 26 May 2026 224 57 167 25%
week of 02 Jun 2026 197 57 140 29%
week of 09 Jun 2026 159 57 102 36%
week of 16 Jun 2026 134 41 93 31%
week of 23 Jun 2026 139 56 83 40%
week of 30 Jun 2026 131 48 83 37%
week of 07 Jul 2026 163 76 87 47%
week of 14 Jul 2026 130 50 80 38%
week of 21 Jul 2026 110 53 57 48%
week of 28 Jul 2026 88 39 49 44%
week of 04 Aug 2026 107 58 49 54%
week of 11 Aug 2026 82 50 32 61%
week of 18 Aug 2026 6 2 4 33%

How this report was made

Population
all Steam reviews of the game (every language, purchase type, and verdict), walked newest-first per window; only English-language reviews are analyzed
Sample
572 English reviews, time-proportional draw over 41 windows (newest-first within each), taken from an all-language walk and kept English-only — where English is a minority the sample runs smaller than the draw, and every margin of error is computed at 572
Aspect yield
398 of 572 analyzed reviews carry at least one aspect (69.6%); every share on this page divides by all 572
Interval regime
calm: standard margins of error for a share of a sample (Wilson interval), no widening needed
Fetch paths
41 time windows fetched directly (windowed)
Language mix
1,000 fetched: english 573 · german 74 · russian 67 · 19 more
Steam-marked windows
none flagged by Steam (Valve's off-topic flagging began March 2019)
Marked share
0.0% of sample inside marked windows, under the 2% floor
Narrative
passed the grounding gate first try
Evidence floor
aspects and emergent themes appear only with 5+ supporting reviews; smaller counts sit at the classifier's false-positive floor
Instrument readings
measured once on the study corpus for this model and prompt: frozen calibration, not properties of this run
· aspect tagging vs. human labels
0.766 [0.713–0.811] (F1 against a human-labeled test set; 1.0 is best)
· quotes filed under the wrong aspect
11.6% [6.6–19.6] of quotes, measured by hand on a sample; lower is better
· independent model vs. production labels
0.791 [0.772–0.810] (F1 of the production labeler against an independent judge model)
Versions
deepseek-v4-flash · prompt classify-v1 · ontology v2
Run
serve-20260818T122439Z-d650bc58 · code ccaa6a4

full methodology in the milestone write-ups