AI Coding Field Notes

Open dataset of what AI coding agents cost: token pricing, per-million rates, and every published figure (prices, percentages, multiples, token counts and durations) as JSON and CSV. Figures are one row each, carrying the sentence they came from. Plus the field notes behind the numbers.

View the Project on GitHub xyzs996/ai-coding-field-notes

Stop Reading SimilarWeb Like a Traffic Dashboard — Read It Like a Feasibility Test

Stop Reading SimilarWeb Like a Traffic Dashboard — Read It Like a Feasibility Test

Written with AI assistance. Figures without a traceable source were cut before publishing.

Most indie developers open SimilarWeb, look at the big monthly visits number, and close the tab. I think that is the single most expensive habit in early product research, because the traffic number is the one figure on the page that cannot tell you whether a market is worth entering.

The useful question is not how many people visit a competitor. It is where those people came from, what they typed to get there, and where they went next.

What the Free Tier Can Actually Tell You

SimilarWeb’s real value sits in three panels, and none of them is the headline count.

Traffic sources tell you whether a competitor is winning on search, on paid acquisition, or on one lucky referral that will never repeat. A site living on paid traffic is a very different opponent from one living on organic search — the first one stops the moment the budget stops, and the second one has a moat you would need months to dig around.

Keyword gaps tell you what people in this niche are searching for that nobody has answered well yet.

Outbound traffic tells you where the audience goes after the visit. That last panel is the one I would look at first if I could only pick one, because it quietly reveals what the visitors actually wanted and did not get.

The free version is genuinely usable for an individual site owner. It is also directionally rough, so pair it with Google Search Console data for the keywords that matter to you — Console gives you your own real queries instead of a modeled estimate, and the two together are far more honest than either alone.

None of this requires a subscription or a research team. It requires you to stop treating the tool as a scoreboard.

Keyword Strategy: Narrow Beats Broad, Almost Always

Chasing broad head keywords as a solo developer is a losing fight, and I do not think that is a controversial claim anymore.

Long-tail keyword strategies reduce ranking risk and get a product visible faster, because the competition thins out dramatically as the query gets more specific. The searcher on a narrow query is also further along — they have stopped browsing and started shopping.

This is where the keyword gap panel pays for itself. You are not looking for the biggest number in the list. You are looking for a phrase specific enough that one person with an afternoon could rank for it.

Demand Is Not the Hard Part — Willingness to Pay Is

Here is the failure mode I see most often: a developer validates that people want something, ships it, and discovers that wanting is not the same as paying.

Validate payment intent before you validate demand, not after. There are three cheap signals, and all three are available in an afternoon.

Do paid tools already exist in this space? A market with no paid tools is usually not an untapped opportunity; it is usually a market that has already answered the question.

What are people complaining about in the communities? Complaints about a paid product are the best text on the internet for this purpose, because someone is telling you exactly what they already opened their wallet for and still resent, and that combination — money already spent, problem still there — is the shortest description of a viable product I have ever come across.

Do the keywords carry commercial intent? “How to do X” and “best X software” are not the same audience, and only one of them is holding a credit card.

Run those three checks and you align product development with what the market has already paid for, instead of what it says it likes.

None of the three requires SimilarWeb, which is part of why I trust them. SimilarWeb tells you the shape of the traffic; the paid-tool census, the complaint threads, and the commercial-intent queries tell you whether that traffic has a wallet attached, and a niche that passes the first test but fails the second is the most expensive kind of false positive an indie developer can chase.

Start With a Small Group, Not a Launch

The Vibe Coding approach is worth borrowing here: find and serve a small group of highly relevant users early, focus on them, and show concrete results.

That sounds slower than a launch. It is faster, because trust compounds and a launch does not.

For developer tools especially, this works better than broad marketing — a small group of relevant users produces the specific, personalized feedback that tells you which feature is load-bearing and which one you invented for yourself. Concrete results shown to a handful of people validate the product’s potential more convincingly than any traffic chart.

Cheap Ways to Test Before You Build

Once you have a hypothesis, Instagram content combined with Meta ads is a low-cost way to generate leads and validate an English-language market. With a budget as low as $30 per day, developers have reached an effective lead cost of $3 to $4. That is controlled and measurable in a way organic content never is — you can kill it on a Tuesday if the numbers say so.

For competitive research, the automation stacks are getting genuinely fast. WorkBuddy combined with BrowserAct can produce a competitive price table in 5 minutes and an opportunity report in 7, which is roughly the difference between checking a hypothesis during a coffee break and scheduling an afternoon for it. I remain a little skeptical of how well those reports hold up on messy niches, but for a first pass on pricing structure the speed is hard to argue with, and a 5-minute price table you can throw away costs you nothing when the niche turns out to be wrong.

WorkBuddy is also the practical option for China-based developers specifically. It removes the network problems, requires no non-Chinese phone number for verification, and carries no account suspension risk — three barriers that eat more time than the actual research does.

If you are evaluating an open-source niche, Zread.ai reads GitHub repositories and generates project overviews, architecture diagrams, and installation guides. It is the fastest way I know to understand whether a codebase is something you could realistically extend, or something you would be signing up to maintain.

And when the evaluation points toward an AI-adjacent niche, harness-anything supplies executable command sets that lower the integration threshold between AI agents and professional software. It is a reusable technical foundation rather than a product, which is exactly what you want at this stage — the market research told you where to go, and this tells you what you would not have to build yourself.

Define the Boundary Before You Write Code

The Shopify comment mining plugin is a good model for what comes after the research. Its MVP had clearly defined boundaries, focused on core capabilities, and deliberately avoided premature platformization.

That last phrase deserves more attention than it usually gets. Platformization is what happens when a validated narrow tool starts growing settings panels for users who have not shown up yet.

The research phase should end with a boundary, not a roadmap.

The Order That Actually Works

If I compressed all of this into a sequence, it would be four steps and none of them involve the monthly visits number.

Read the traffic sources to learn how the incumbents actually win. Read the keyword gaps to find a phrase narrow enough to own. Check the three payment signals — paid tools, community complaints, commercial-intent queries — before you commit. Then serve a small group of highly relevant users and show them something concrete.

Maybe your niche survives all four. Maybe it dies at step three, which is the cheapest place a product idea can possibly die.

Either way you spent an afternoon instead of a quarter, and you have data instead of a hunch.

Also readable on Telegraph.


Read next

All 30 write-ups

The 5 figures in this piece — each with the sentence it came from — are in the figures table, alongside 301 more, as JSON and CSV.

Topics: Indie Development · Niche Market · AI Tools


Part of ai-coding-field-notes — field notes on AI coding agents.

Want a figure that is not in here yet? Say which metric, which provider, which unit in the open thread — replies get turned into rows. Got a better number? Open an issue — corrections and counter-data are the point. If this collection saved you an afternoon, a star helps other people find it; the data is CC BY and does not require starring.