GitVelocity vs DX: Measuring What Engineers Ship vs How They Feel
Comparing GitVelocity and DX — one uses AI to score shipped code, the other uses surveys to capture developer sentiment. Scored engineering vs reported experience.
DX takes an approach to engineering measurement that's genuinely different from most tools in the space: it asks developers directly. Through structured surveys, DX captures how engineers feel about their productivity -- what's blocking them, where friction lives, how satisfied they are with their tools and processes.
GitVelocity doesn't ask anyone anything. It reads every merged PR diff and scores it 0-100 using Claude across six engineering dimensions. No surveys, no self-reporting, no qualitative interpretation. Just an AI assessment of the shipped code.
This is the most philosophically interesting comparison in the engineering analytics space. DX measures subjective experience. GitVelocity measures the engineering that ships. Both capture something real. Neither captures everything.
How DX Works
DX is built on the research of Abi Noda and the idea that developer experience directly drives developer productivity. The platform runs periodic surveys that ask engineers structured questions about their work environment -- tooling friction, documentation quality, ease of releasing code, clarity of requirements, technical debt burden.
The surveys are well-designed. They're grounded in academic research — the SPACE framework and DX's own Core 4 methodology, developed with Forsgren, Storey, Zimmerman, and others — and they capture signals that no system metric can detect. If your CI pipeline is technically fast but developers find it confusing and unreliable, DORA metrics won't tell you that. DX surveys will.
DX also provides benchmarks, comparing your survey responses against industry aggregates so you can see where your developer experience stands relative to peers. That benchmarking is useful for identifying blind spots -- areas where your organization assumes things are fine but developers disagree.
The platform has expanded significantly beyond pure surveys. DX's Data Cloud product connects to GitHub, GitLab, Jira, and other tools to incorporate system metrics alongside survey data. DX was acquired by Atlassian in late 2025, which will likely accelerate its platform capabilities. But the core value proposition remains qualitative: understand how your engineers experience their work.
What Surveys Capture That Code Analysis Can't
I want to be direct about what surveys do well, because this comparison deserves intellectual honesty.
A developer might be shipping complex, high-scoring PRs while fighting a terrible local development environment that makes every change take twice as long as it should. GitVelocity sees the shipped work and scores it well. DX captures the friction that's invisible in the shipped artifact.
Similarly, a team might have strong velocity while key engineers are deeply frustrated by unclear requirements, poor documentation, or institutional dysfunction. Those frustrations are real, they affect retention, and they'll eventually show up in what ships -- but by then it's too late. Surveys catch the leading indicators that code scores miss.
DX's research-backed methodology is genuinely rigorous. This isn't a "rate your satisfaction 1-5" checkbox. The survey instruments are designed to isolate specific dimensions of developer experience and produce actionable, comparable data.
Where Surveys Run Into Structural Limits
Here's where I'll push back, and I'll be honest about the reasoning.
Surveys measure perception, not reality. An engineer might report feeling productive in a survey while the engineering they ship has declined. Another might report high frustration while shipping the best work on the team. Perception and shipped work correlate, but not as tightly as survey advocates suggest.
Survey frequency creates gaps. DX's core surveys typically run quarterly or monthly, though their PlatformX feature captures some in-the-moment data via event-triggered micro-surveys. Still, the primary data collection mechanism produces snapshots, not continuous data. A lot changes between surveys, and the retrospective nature of self-reporting introduces recall bias -- people remember recent frustrations more vividly than recent wins.
There's also the response rate problem. Not all engineers fill out surveys consistently, and the ones who do may not be representative. Engineers who are deeply frustrated or deeply satisfied are more likely to respond than those in the middle, which can skew the picture.
And fundamentally, surveys can't tell you what shipped. They tell you how developers feel about shipping it. The engineering itself -- its scope, quality, architecture -- requires looking at the code, not asking about it.
What GitVelocity Measures
GitVelocity takes every merged PR diff and scores it across Scope, Architecture, Implementation, Risk, Quality, and Performance/Security. The score is continuous -- every PR gets evaluated, not just quarterly snapshots. The scoring is consistent -- the same PR scores within 2-4 points on repeated evaluation.
This means you get an objective, ongoing measure of what your team produces. Not what they think they produce. Not how they feel about producing it. What the code actually is.
A developer who feels unproductive but ships a complex, well-architected refactor gets credit for what they built. A developer who feels highly productive but ships a series of trivial changes gets scored for what they shipped. The AI doesn't care about sentiment -- it evaluates the artifact.
The Satisfaction-Engineering Gap
This is the tension at the heart of the comparison.
A team with excellent developer experience scores -- great tools, supportive management, reasonable work-life balance -- might be coasting. They're comfortable, satisfied, and shipping routine work. DX scores look great. The engineering they ship might be unremarkable.
A different team might report lower satisfaction -- they're tackling hard problems with imperfect tools, pushing architectural boundaries, dealing with the discomfort that comes with ambitious technical work. DX scores suffer. The engineering they ship might be extraordinary.
I'm not arguing that satisfaction doesn't matter. Sustained dissatisfaction leads to turnover, and turnover is expensive. But satisfaction without measuring what ships gives you an incomplete picture. You can have a happy, comfortable team that isn't producing substantial engineering work.
Velocity without satisfaction is also unsustainable. A team shipping hard, high-scoring code while burning out is accumulating organizational debt. Both signals matter. But confusing one for the other leads to bad decisions.
The AI-Era Angle
As AI coding tools reshape how code gets written, the gap between experience metrics and engineering scores shifts in an interesting way.
DX surveys will capture how developers feel about AI tools -- whether they help, whether they add friction, whether developers trust them. That's genuinely useful for adoption decisions.
GitVelocity will capture whether the code produced with AI assistance carries real engineering and is well-built. That's useful for understanding whether AI tools are driving real engineering or just accelerating trivial work.
A developer might report loving their AI coding assistant (great DX survey response) while primarily using it to generate boilerplate (low GitVelocity scores). Or they might report finding AI tools frustrating (poor DX survey response) while the tool is quietly helping them tackle more ambitious problems (high GitVelocity scores). Sentiment and scores can diverge.
The Individual Visibility Question
DX intentionally anonymizes survey data to protect developer trust. You see team-level or cohort-level sentiment trends, not individual engineer feedback. This is a deliberate and defensible design choice -- surveys lose value the moment engineers worry their responses will be used against them.
GitVelocity provides individual-level scoring by design. Each engineer's merged PRs are scored, and you can see per-person trends, averages, and distributions. This is useful for one-on-ones, growth conversations, and identifying engineers who consistently ship substantial engineering.
These approaches serve different management needs. Anonymized sentiment data helps you fix systemic problems. Individual scoring data helps you coach specific engineers and recognize specific contributions.
Head-to-Head Comparison
| Feature | GitVelocity | DX |
|---|---|---|
| Primary Focus | Engineering in each PR | Developer experience and sentiment |
| Data Source | Merged PR diffs analyzed by AI | Developer surveys + some system metrics |
| Measurement Type | Objective -- AI scores shipped code | Subjective -- engineers self-report experience |
| Frequency | Continuous -- every merged PR | Periodic -- quarterly or monthly surveys |
| Pricing | Free forever (BYOK) | Enterprise pricing |
| Individual Visibility | Per-engineer PR scoring | Anonymized survey aggregates |
| Platforms | GitHub, GitLab, Bitbucket | GitHub, GitLab, Jira + surveys (now part of Atlassian) |
| Gaming Resistance | High -- scores the actual code | Moderate -- survey responses can reflect perception bias |
| What It Reveals | How much engineering ships | Developer friction and satisfaction |
| Historical Backfill | 3+ months of PR data | Only from survey start date |
When to Choose DX
- Developer experience improvement is your primary organizational goal
- You want research-backed measurement grounded in the DX Core 4 framework
- Understanding developer friction and satisfaction matters more than scoring what ships
- Your organization has the budget for enterprise pricing
- Anonymized, aggregate data is preferred over individual-level scoring
- Benchmarking developer experience against industry peers is valuable
When to Choose GitVelocity
- You want to measure what your team ships, not how they feel about shipping it
- Continuous, objective scoring matters more than periodic perception snapshots
- Individual-level visibility into what engineers ship is important for coaching and performance conversations
- Gaming-resistant metrics based on the actual code are a priority
- Budget is a factor -- free with BYOK vs. enterprise pricing
- AI-era measurement of shipped engineering regardless of tooling matters
- Historical backfill -- instant baselines from three months of PR data
Sentiment and Substance
DX captures the subjective reality of building software -- the friction, the satisfaction, the blockers that system metrics can't see. GitVelocity captures the objective reality of what gets built -- scope scored, architecture evaluated, quality assessed.
For teams that already survey their engineers and have a good read on developer sentiment, the missing piece is usually an objective read on the engineering that ships. GitVelocity fills that gap for free, with scored data available in minutes -- continuous measurement that doesn't wait for the next survey cycle.
GitVelocity measures engineering velocity by scoring every merged PR using AI. Objective scoring that captures how much engineering your team ships, not what they report.
Conrad is CTO and Partner at Headline, where he leads data-driven investment across early stage and growth funds with over $4B in AUM. Before becoming an investor, he founded Munchery (raised $130M+) and held engineering and product leadership roles at IAC and Convio (IPO 2010). He and the Headline engineering team built GitVelocity to help engineering organizations roll out agentic coding and measure its impact.