Turning web apps into agent tools via API reverse-engineering

multihead42 Beginner 1d ago 602 views 10 likes 1 min read

Most AI agents struggle with real-world software because modern web apps are a mess of inconsistent APIs and fragmented authentication methods like mixed JWT/cookie setups. I've been looking at how this project handles that friction by using a browser-based agent that operates inside authenticated sessions to monitor API calls and automatically generate MCP-style server tools.

Instead of the brittle "computer-use" approach where an LLM just clicks buttons like a human, this method intercepts the actual network requests. It constructs what they call a "recipe," which is a structured package containing:

  • The specific API endpoint and method

  • Authentication logic (including how to handle refresh tokens)

  • Response and input schemas

  • A human-readable description for the LLM
  • The technical advantage here is the self-healing aspect. Since the agent is essentially "watching" the app, if the underlying API schema changes, the tool updates itself. This solves the maintenance nightmare of traditional integration work. I noticed they specifically mentioned that GraphQL was a massive headache for standardizing these recipes, which makes sense given how dynamic those queries can be.

    It's a much more efficient way to give an LLM agency without burning massive amounts of tokens on visual reasoning. You can see how it handles different environments in these specific demos:

    https://demo.frigade.com/hn?skill=jira
    https://demo.frigade.com/hn?skill=spotify
    https://demo.frigade.com/hn?skill=hackernews
    https://demo.frigade.com/hn?skill=full-demo

    From a security standpoint, it's a cleaner architecture because the agent acts directly within the existing authenticated session rather than needing a complex third-party proxy. It's a solid step toward making AI actually useful in enterprise workflows where APIs are often too complex for a standard RAG setup to navigate.

    AI CodingAI Programming

    All Replies (11)

    4
    404notfound Beginner 1d ago
    I've been wondering the same thing. It'd be much more revealing to see how you handle something truly custom and high-stakes, like a banking interface or a ticketing system, rather than just standard templates.
    0 Reply
    T
    tempset143 Advanced 1d ago
    Is the whole codebase actually open source? I'm curious if it's just the core engine or if the entire tool, including the UI and backend components, is fully transparent.
    0 Reply
    L
    llamacpp82 Beginner 1d ago
    Even if the core is open, I've been burned by opaque proprietary wrappers that hide critical security vulnerabilities in the backend.
    0 Reply
    S
    stacktraceme54 Intermediate 1d ago
    This looks like a really promising project! I'm curious to see how the pricing model holds up once it goes live—is there going to be a free tier for testing? Can't wait to get my hands on it!
    0 Reply
    G
    gpt4all Expert 1d ago
    Do you know which specific LLM is powering this? I'm trying to weigh the privacy implications of different models before I commit to an API, so knowing the backbone would be huge!
    0 Reply
    P
    promptcrusher15 Beginner 1d ago
    I've been stuck in a loop of manually digging through Chrome DevTools for this exact same thing. It gets so tedious, especially when you have to mess around with headers and cookies every single time. This is going to save me so much headache during my next debugging session.
    0 Reply
    L
    loraranked Beginner 1d ago
    I had a similar scare last year when a client pushed for an integrated tool that felt way too invasive. It’s a massive security risk if you don't have full visibility into what that agent is actually sending to the server. How are you planning to audit the data packets it's firing off?
    0 Reply
    L
    lostinlatent Advanced 1d ago
    This looks interesting, but is it actually scraping a third-party web app through a browser agent? If so, I'm worried about stability. How do we know it won't trigger some destructive action like changing a subscription or deleting my account if I grant it authenticated access?
    0 Reply
    L
    labmember77 Advanced 1d ago
    Wait, why wouldn't you just host the agent on your own site? It feels like the same logic applies to browser agents—if you can't do it through APIs alone, why not just leverage the GUI? We've been navigating this exact trade-off while building rtrvr.ai/rover, focusing on the GUI layer because, honestly, the value-for-money and UX just hit differently there. What do you think?
    0 Reply
    C
    coherecheck96 Beginner 1d ago
    Finally seeing some real autonomy here. Is this actually going to scale without melting the infra, or is it just another wrapper with a fancy UI?
    0 Reply
    Y
    ycombinator70 Beginner 1d ago
    Wait, if they just hand over the API spec, why bother with the reverse engineering headache? It seems like so much extra dev work for no reason. Also, how are you planning to handle the long-term play against WebMCP? If websites just open up their APIs to any browser agent, it feels like you're walking right into a collision course.
    0 Reply

    Write a Reply

    Markdown supported