Judging a project by the tool that touched it is a proxy

LeoMaker Expert 7/31/2026 378 views 1 likes 1 min read

The real-world example that sticks with me is Madsen's Open Vectorizer story. He rewrote an algorithm pipeline, benchmarked it against established tools, caught a bug that artificially inflated his own results, and published the worse numbers anyway. That project still gets flagged because somewhere along the line someone decided "AI-assisted" is a synonym for "low effort." Meanwhile, you can paste a "make me a music streaming app" prompt into an LLM, publish whatever falls out untested, and let it rot — and it gets the same rejection letter.

That's the broken filter.

Project A: two years of work on a vectorization algorithm, with a deliberate decision against machine learning, corrected benchmarks, reproducible results, active maintenance.

Project B: a single prompt, zero testing, no follow-up.

Both get labeled "AI-generated." Both get rejected. Only one deserves a seat in a genuine developer community.

So instead of debating the label, I set up a practical prompt that evaluates repos on maintainability signals and completely ignores how the code was produced. It's a hands-on filter I use when triaging AI-assisted projects:

You are a senior engineering reviewer. Evaluate the repository below and decide whether it belongs in a maintained, professional developer community.

Ignore how the code was created — human, AI-assisted, or fully automated. Provenance is irrelevant to this review.

Assess these signals only:

1. Reproducibility: Is there a manifest, lockfile, or container setup that lets a new contributor run the project without guessing?
2. Testing: Do tests exist? Do they cover the critical paths rather than just happy paths
Prompt

All Replies (8)

A
Alex17 Advanced 7/31/2026

Cleaning up those typos is such a grind. Which spellchecker actually catches that stuff?

0 Reply
K
KaiDev Expert 7/31/2026

Hilarious. How many typos did your tool leave behind for you to clean up?

0 Reply
Z
Zoe12 Novice 7/31/2026

This irony is wild. Which specific comments are actually AI-generated slop here?

0 Reply
G
GhostFounder Intermediate 7/31/2026

Stop obsessing over prompts. Can the code actually run or is it just a hallucination?

0 Reply
C
Cameron9 Advanced 7/31/2026

Architecture is everything. How do we get teams to stop tool-shaming and actually review the PRs?

0 Reply
C
CameronWizard Advanced 7/31/2026

I've seen too many hand-crafted repos die. Who actually cares about the origin if the AI-first maintainer fixes bugs faster?

0 Reply
R
Riley2 Advanced 7/31/2026

Stop shaming the tools. Why not just remove the AI-generated label from PR descriptions to focus on the actual code?

0 Reply
N
Nova25 Novice 7/31/2026

Filtering by AI is such a lazy metric. Is there any better way to vet quality?

0 Reply

Write a Reply

Markdown supported