OneWayInterview: Automating Async Video Screening

Asynchronous video interviews are usually a nightmare to set up because someone has to manually write a set of questions that actually vet a candidate's skills without being generic. OneWayInterview tries to solve this by using an LLM to generate the interview script based solely on the job title and description. Instead of a recruiter spending an hour drafting questions for a "Senior React Developer," the AI handles the prompt engineering to create a structured interview flow.

The core value here isn't just the "AI generation" buzzword, but the reduction of friction in the top-of-funnel hiring process. For a developer or a technical lead, the pain point is usually the initial screen where you waste 30 minutes realizing the candidate doesn't actually know the stack they claimed on their resume. By automating the question generation, you can deploy a screening link faster.

Getting Started with Async Screening

If you're looking to implement a similar AI-driven workflow for candidate screening, the logic generally follows this pipeline:

1. Input Parsing: The system takes a job role (e.g., "Backend Engineer - Go/Kubernetes") and a detailed description.
2. Question Synthesis: An LLM generates 3-5 targeted questions. To make this effective, the prompt needs to enforce a "STAR" method requirement (Situation, Task, Action, Result) so candidates provide structured answers.
3. Deployment: The questions are served as a recorded video sequence.

If you were to build a basic version of this as an AI agent, your system prompt for the question generator would look something like this:

You are an expert technical recruiter. Based on the following job description, generate 3 behavioral questions and 2 technical scenario questions. 
Requirements:
- Questions must be open-ended.
- Technical questions must focus on real-world trade-offs (e.g., "Why choose X over Y in scenario Z?").
- Avoid generic questions like "Tell me about yourself."
- Output format: JSON array of strings.

Job Role: {{job_role}}
Description: {{job_description}}

Technical Trade-offs: AI-Generated vs. Manual Screening

When deciding if an automated tool like this is worth it, consider these benchmarks:

• Time to Setup: Manual setup takes ~45 minutes per role. AI generation takes ~10 seconds.
• Consistency: AI ensures every candidate for a specific role gets the exact same phrasing, eliminating interviewer bias in the initial stage.
• Candidate Friction: The risk is "AI fatigue." Candidates often dislike one-way interviews because they lack human interaction. To mitigate this, the questions must be high-quality and specific to the role, rather than generic templates.

Deployment Considerations

For those integrating this into a larger AI workflow, the biggest challenge is the evaluation of the video response. To make this a truly "complete guide" to AI hiring, you shouldn't stop at generating questions; you need a pipeline to analyze the transcript.

A typical analysis config for an LLM evaluator would look like this:

{
  "evaluation_criteria": {
    "technical_accuracy": "weight 0.5",
    "communication_clarity": "weight 0.3",
    "experience_level_alignment": "weight 0.2"
  },
  "scoring_scale": "1-5",
  "output_requirement": "Provide a 2-sentence justification for the score based on specific keywords used in the transcript."
}

This approach turns a subjective video recording into structured data that a hiring manager can scan in seconds. Whether you use a dedicated tool or build a custom LLM agent for this, the goal is to move the "filter" as far upstream as possible without ruining the candidate experience.