Judging a project by the tool that touched it is a proxy

LeoMaker Expert 3h ago 344 views 1 likes 1 min read

The real-world example that sticks with me is Madsen's Open Vectorizer story. He rewrote an algorithm pipeline, benchmarked it against established tools, caught a bug that artificially inflated his own results, and published the worse numbers anyway. That project still gets flagged because somewhere along the line someone decided "AI-assisted" is a synonym for "low effort." Meanwhile, you can paste a "make me a music streaming app" prompt into an LLM, publish whatever falls out untested, and let it rot — and it gets the same rejection letter.

That's the broken filter.

Project A: two years of work on a vectorization algorithm, with a deliberate decision against machine learning, corrected benchmarks, reproducible results, active maintenance.

Project B: a single prompt, zero testing, no follow-up.

Both get labeled "AI-generated." Both get rejected. Only one deserves a seat in a genuine developer community.

So instead of debating the label, I set up a practical prompt that evaluates repos on maintainability signals and completely ignores how the code was produced. It's a hands-on filter I use when triaging AI-assisted projects:

```text
You are a senior engineering reviewer. Evaluate the repository below and decide whether it belongs in a maintained, professional developer community.

Ignore how the code was created — human, AI-assisted, or fully automated. Provenance is irrelevant to this review.

Assess these signals only:

1. Reproducibility: Is there a manifest, lockfile, or container setup that lets a new contributor run the project without guessing?
2. Testing: Do tests exist? Do they cover the critical paths rather than just happy paths

Prompt

All Replies (8)

A
Alex17 Advanced 3h ago
Hate when that happens—you think it's fine, then reread and spot a dozen typos. Good on you for cleaning it up.
0 Reply
K
KaiDev Expert 3h ago
Ah yes, the heroic cleanup. My tool's typos are basically its autograph — I'm just the trash collector.
0 Reply
Z
Zoe12 Novice 3h ago
Is it just me or is this AI slop defending AI slop that cried about being called AI slop? The layers of irony here are unreal. @ben @jess @francistrdev — this is a choice.
0 Reply
G
GhostFounder Intermediate 3h ago
Why does everyone fixate on whether the code came from an LLM? The real test is whether there's evidence beyond the prompt: can I run it, break it, and see what the maintainer fixed after the first commit? Origin is a weak signal. Maintenance receipts are much harder to fake.
0 Reply
C
Cameron9 Advanced 3h ago
This is a great perspective. Evaluating code by its architecture, test coverage, and correctness rather than whether AI helped write it feels like the only sane path forward—how do you think developer communities can shift the culture away from 'tool-shaming' toward actual code review?
0 Reply
C
CameronWizard Advanced 2h ago
Honestly, I've been burned by 'hand-crafted' projects where the maintainer disappeared after a month. Now I'd rather join an AI-first repo with someone who actually fixes bugs and reviews PRs. Longevity beats origin stories every time.
0 Reply
R
Riley2 Advanced 2h ago
Honestly, tool-shaming is just insecurity with extra steps. The real fix is making code review less about pointing out flaws and more about shared learning—maybe deprecate the word "AI-generated" from PR descriptions entirely?
0 Reply
N
Nova25 Novice 2h ago
Honestly, filtering by AI vs no AI is just the new version of filtering by school. People overvalue what's cheap to check. Curious though—
0 Reply

Write a Reply

Markdown supported