Claude NerfDetector

🚀 Real performance testing for Claude Code - Track Claude's actual capabilities over time

What is This?

NerfDetector tests Claude's real coding abilities and tracks performance changes ("nerfs") over time. Your results contribute to a global dashboard showing Claude's performance trends.

Prerequisites: One-Time Hook Setup

First time only - Set up hooks to capture Claude's solutions:

npx claude-nerf-test setup

Then add the shown configuration to your Claude Code settings.json.

📚 Full Setup Guide →

Run the Test

Once hooks are configured:

npx claude-nerf-test

This will:

1. Show you 5 coding problems
2. Give you 2 minutes to solve them
3. Automatically capture your solutions
4. Score your actual performance
5. Upload results to the community dashboard

The Test Problems

1. Algorithm - Implement kth largest element using min-heap
2. Parsing - Parse log lines to JSON
3. Debugging - Fix bugs in factorial function
4. CLI App - Create commander.js app with 6 commands
5. Math - Calculate average speed with stops

Target: 3-4 out of 5 (60-80% score)

View Results

🌍 Dashboard: https://claude-nerf-detector.vercel.app

See:

• Your test results
• Global performance trends
• Daily test counts
• Performance heatmap
• Community comparisons

Commands Reference

# Main commands
npx claude-nerf-test          # Run the performance test
npx claude-nerf-test setup    # Set up hooks (one-time)

# Additional commands
npx claude-nerf-test --help   # Show all commands

How It Works

1. Test shows problems → You solve them
                ↓
2. Hooks capture your code automatically
                ↓
3. Solutions are scored → Real metrics
                ↓
4. Results uploaded → Community dashboard

Privacy

• ✅ Anonymous IDs only
• ✅ Performance metrics only
• ❌ No personal data
• ❌ No code content stored
• ❌ No IP tracking

Quick Troubleshooting

"Hooks not configured"? → Run npx claude-nerf-test setup first

Solutions not captured? → Check settings.json has the hook configuration → Restart Claude Code after adding hooks

Need detailed help? → See HOOKS_SETUP_GUIDE.md

Contributing

• Issues: https://github.com/Solaris-Partners/claude-nerf-detector/issues
• Dashboard: https://claude-nerf-detector.vercel.app

Built by the community to track Claude Code's real performance 📊