
Samvel Avagyan
I build AI products and score them before release. The eval harness is public and pre-registered.
Open to a full-time remote role or a fixed-scope project.
7 years on the web, 3 shipping LLM products
the work history below5+ AI products in production
the case studiesSkill activation 0.33 to 0.83, n = 30
the repository at the tagWhat I build, and how it gets measured
I'm Samvel Avagyan. I build AI products end to end and score them before release. I work from Yerevan, Armenia, on UTC+4, through Samwell.dev, the studio that has carried my client work since August 2024dated roles, this page. Seven years of that work has been on the web, the last three shipping LLM products.
The scoring is public. DirectiveForge is my eval harness for AI workflows: MIT licensed, pre-registered so the spec is committed before the results, and readable at github.com/directiveforge/directiveforge. It measures 22 skillspublic repo, tag v0.20.0-public on trigger F1, which counts how often a skill fires when it should and stays quiet when it should not, and it publishes a Wilson 95% confidence interval for each one at n = 30. One regression is published next to the gains.
The same habit runs through the client work. I built Teach For Armenia a donation platform on Fastify and PostgreSQL, with AmeriaBank vPOS 3.1 and AES-256-GCM encryption at rest. It runs in production. The Name.am builder I led generated more than 1,000 sitesName.am case study and took 40% off build time. At Dr.Acula, token spend fell 45% in one month on the model billing dashboard, and the landing page was rebuilt to a performance budget.
The same work is available as an eval audit of a feature you already ship, one AI feature shipped and scored and a whole product built end to end. The project case studies carry each number with the source it came from.
Selected work
See all projectsWhat each tool was used on, and what was counted
What the services are written in
Interface and quality gates
- Core Web VitalsDeveloping the Dr.Acula Landing Page
- Technical SEO / JSON-LDName.am: interface rebuild, technical SEO, AI suggestions
Payments, stored data and the content clients edit
- Payment integrationTeach For Armenia donation platform, in production
Model work and the checks on it
- Evals and LLMOpsDirectiveForge: AI workflow kits with published evals
- Anthropic ClaudeDirectiveForge: AI workflow kits with published evals
- Agents and orchestrationDeveloping the Dr.Acula Landing Page
- Anti-hallucination gatesDirectiveForge: AI workflow kits with published evals
- Prompt engineeringName.am AI website builder: 1,000+ sites generated
- SSE streamingName.am AI website builder: 1,000+ sites generated
- Claude Code / Cursor workflow engineeringDirectiveForge: AI workflow kits with published evals
Work history
Employment
Clients via Samwell.dev
Own products
Education
Open to a full-time remote role or a fixed-scope project. Remote, UTC+4.
