feat: CRM Clinicas SaaS - MVP completo
- Auth: Login/Register con creacion de clinica - Dashboard: KPIs reales, graficas recharts - Pacientes: CRUD completo con busqueda - Agenda: FullCalendar, drag-and-drop, vista recepcion - Expediente: Notas SOAP, signos vitales, CIE-10 - Facturacion: Facturas con IVA, campos CFDI SAT - Inventario: Productos, stock, movimientos, alertas - Configuracion: Clinica, equipo, catalogo servicios - Supabase self-hosted: 18 tablas con RLS multi-tenant - Docker + Nginx para produccion Co-Authored-By: claude-flow <ruv@ruv.net>
This commit is contained in:
Consultoria AS
649
.claude/skills/verification-quality/SKILL.md
Normal file
649
.claude/skills/verification-quality/SKILL.md
Normal file
@@ -0,0 +1,649 @@
|
||||
---
|
||||
name: "Verification & Quality Assurance"
|
||||
description: "Comprehensive truth scoring, code quality verification, and automatic rollback system with 0.95 accuracy threshold for ensuring high-quality agent outputs and codebase reliability."
|
||||
version: "2.0.0"
|
||||
category: "quality-assurance"
|
||||
tags: ["verification", "truth-scoring", "quality", "rollback", "metrics", "ci-cd"]
|
||||
---
|
||||
|
||||
# Verification & Quality Assurance Skill
|
||||
|
||||
## What This Skill Does
|
||||
|
||||
This skill provides a comprehensive verification and quality assurance system that ensures code quality and correctness through:
|
||||
|
||||
- **Truth Scoring**: Real-time reliability metrics (0.0-1.0 scale) for code, agents, and tasks
|
||||
- **Verification Checks**: Automated code correctness, security, and best practices validation
|
||||
- **Automatic Rollback**: Instant reversion of changes that fail verification (default threshold: 0.95)
|
||||
- **Quality Metrics**: Statistical analysis with trends, confidence intervals, and improvement tracking
|
||||
- **CI/CD Integration**: Export capabilities for continuous integration pipelines
|
||||
- **Real-time Monitoring**: Live dashboards and watch modes for ongoing verification
|
||||
|
||||
## Prerequisites
|
||||
|
||||
- Claude Flow installed (`npx claude-flow@alpha`)
|
||||
- Git repository (for rollback features)
|
||||
- Node.js 18+ (for dashboard features)
|
||||
|
||||
## Quick Start
|
||||
|
||||
```bash
|
||||
# View current truth scores
|
||||
npx claude-flow@alpha truth
|
||||
|
||||
# Run verification check
|
||||
npx claude-flow@alpha verify check
|
||||
|
||||
# Verify specific file with custom threshold
|
||||
npx claude-flow@alpha verify check --file src/app.js --threshold 0.98
|
||||
|
||||
# Rollback last failed verification
|
||||
npx claude-flow@alpha verify rollback --last-good
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Complete Guide
|
||||
|
||||
### Truth Scoring System
|
||||
|
||||
#### View Truth Metrics
|
||||
|
||||
Display comprehensive quality and reliability metrics for your codebase and agent tasks.
|
||||
|
||||
**Basic Usage:**
|
||||
```bash
|
||||
# View current truth scores (default: table format)
|
||||
npx claude-flow@alpha truth
|
||||
|
||||
# View scores for specific time period
|
||||
npx claude-flow@alpha truth --period 7d
|
||||
|
||||
# View scores for specific agent
|
||||
npx claude-flow@alpha truth --agent coder --period 24h
|
||||
|
||||
# Find files/tasks below threshold
|
||||
npx claude-flow@alpha truth --threshold 0.8
|
||||
```
|
||||
|
||||
**Output Formats:**
|
||||
```bash
|
||||
# Table format (default)
|
||||
npx claude-flow@alpha truth --format table
|
||||
|
||||
# JSON for programmatic access
|
||||
npx claude-flow@alpha truth --format json
|
||||
|
||||
# CSV for spreadsheet analysis
|
||||
npx claude-flow@alpha truth --format csv
|
||||
|
||||
# HTML report with visualizations
|
||||
npx claude-flow@alpha truth --format html --export report.html
|
||||
```
|
||||
|
||||
**Real-time Monitoring:**
|
||||
```bash
|
||||
# Watch mode with live updates
|
||||
npx claude-flow@alpha truth --watch
|
||||
|
||||
# Export metrics automatically
|
||||
npx claude-flow@alpha truth --export .claude-flow/metrics/truth-$(date +%Y%m%d).json
|
||||
```
|
||||
|
||||
#### Truth Score Dashboard
|
||||
|
||||
Example dashboard output:
|
||||
```
|
||||
📊 Truth Metrics Dashboard
|
||||
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
|
||||
|
||||
Overall Truth Score: 0.947 ✅
|
||||
Trend: ↗️ +2.3% (7d)
|
||||
|
||||
Top Performers:
|
||||
verification-agent 0.982 ⭐
|
||||
code-analyzer 0.971 ⭐
|
||||
test-generator 0.958 ✅
|
||||
|
||||
Needs Attention:
|
||||
refactor-agent 0.821 ⚠️
|
||||
docs-generator 0.794 ⚠️
|
||||
|
||||
Recent Tasks:
|
||||
task-456 0.991 ✅ "Implement auth"
|
||||
task-455 0.967 ✅ "Add tests"
|
||||
task-454 0.743 ❌ "Refactor API"
|
||||
```
|
||||
|
||||
#### Metrics Explained
|
||||
|
||||
**Truth Scores (0.0-1.0):**
|
||||
- `1.0-0.95`: Excellent ⭐ (production-ready)
|
||||
- `0.94-0.85`: Good ✅ (acceptable quality)
|
||||
- `0.84-0.75`: Warning ⚠️ (needs attention)
|
||||
- `<0.75`: Critical ❌ (requires immediate action)
|
||||
|
||||
**Trend Indicators:**
|
||||
- ↗️ Improving (positive trend)
|
||||
- → Stable (consistent performance)
|
||||
- ↘️ Declining (quality regression detected)
|
||||
|
||||
**Statistics:**
|
||||
- **Mean Score**: Average truth score across all measurements
|
||||
- **Median Score**: Middle value (less affected by outliers)
|
||||
- **Standard Deviation**: Consistency of scores (lower = more consistent)
|
||||
- **Confidence Interval**: Statistical reliability of measurements
|
||||
|
||||
### Verification Checks
|
||||
|
||||
#### Run Verification
|
||||
|
||||
Execute comprehensive verification checks on code, tasks, or agent outputs.
|
||||
|
||||
**File Verification:**
|
||||
```bash
|
||||
# Verify single file
|
||||
npx claude-flow@alpha verify check --file src/app.js
|
||||
|
||||
# Verify directory recursively
|
||||
npx claude-flow@alpha verify check --directory src/
|
||||
|
||||
# Verify with auto-fix enabled
|
||||
npx claude-flow@alpha verify check --file src/utils.js --auto-fix
|
||||
|
||||
# Verify current working directory
|
||||
npx claude-flow@alpha verify check
|
||||
```
|
||||
|
||||
**Task Verification:**
|
||||
```bash
|
||||
# Verify specific task output
|
||||
npx claude-flow@alpha verify check --task task-123
|
||||
|
||||
# Verify with custom threshold
|
||||
npx claude-flow@alpha verify check --task task-456 --threshold 0.99
|
||||
|
||||
# Verbose output for debugging
|
||||
npx claude-flow@alpha verify check --task task-789 --verbose
|
||||
```
|
||||
|
||||
**Batch Verification:**
|
||||
```bash
|
||||
# Verify multiple files in parallel
|
||||
npx claude-flow@alpha verify batch --files "*.js" --parallel
|
||||
|
||||
# Verify with pattern matching
|
||||
npx claude-flow@alpha verify batch --pattern "src/**/*.ts"
|
||||
|
||||
# Integration test suite
|
||||
npx claude-flow@alpha verify integration --test-suite full
|
||||
```
|
||||
|
||||
#### Verification Criteria
|
||||
|
||||
The verification system evaluates:
|
||||
|
||||
1. **Code Correctness**
|
||||
- Syntax validation
|
||||
- Type checking (TypeScript)
|
||||
- Logic flow analysis
|
||||
- Error handling completeness
|
||||
|
||||
2. **Best Practices**
|
||||
- Code style adherence
|
||||
- SOLID principles
|
||||
- Design patterns usage
|
||||
- Modularity and reusability
|
||||
|
||||
3. **Security**
|
||||
- Vulnerability scanning
|
||||
- Secret detection
|
||||
- Input validation
|
||||
- Authentication/authorization checks
|
||||
|
||||
4. **Performance**
|
||||
- Algorithmic complexity
|
||||
- Memory usage patterns
|
||||
- Database query optimization
|
||||
- Bundle size impact
|
||||
|
||||
5. **Documentation**
|
||||
- JSDoc/TypeDoc completeness
|
||||
- README accuracy
|
||||
- API documentation
|
||||
- Code comments quality
|
||||
|
||||
#### JSON Output for CI/CD
|
||||
|
||||
```bash
|
||||
# Get structured JSON output
|
||||
npx claude-flow@alpha verify check --json > verification.json
|
||||
|
||||
# Example JSON structure:
|
||||
{
|
||||
"overallScore": 0.947,
|
||||
"passed": true,
|
||||
"threshold": 0.95,
|
||||
"checks": [
|
||||
{
|
||||
"name": "code-correctness",
|
||||
"score": 0.98,
|
||||
"passed": true
|
||||
},
|
||||
{
|
||||
"name": "security",
|
||||
"score": 0.91,
|
||||
"passed": false,
|
||||
"issues": [...]
|
||||
}
|
||||
]
|
||||
}
|
||||
```
|
||||
|
||||
### Automatic Rollback
|
||||
|
||||
#### Rollback Failed Changes
|
||||
|
||||
Automatically revert changes that fail verification checks.
|
||||
|
||||
**Basic Rollback:**
|
||||
```bash
|
||||
# Rollback to last known good state
|
||||
npx claude-flow@alpha verify rollback --last-good
|
||||
|
||||
# Rollback to specific commit
|
||||
npx claude-flow@alpha verify rollback --to-commit abc123
|
||||
|
||||
# Interactive rollback with preview
|
||||
npx claude-flow@alpha verify rollback --interactive
|
||||
```
|
||||
|
||||
**Smart Rollback:**
|
||||
```bash
|
||||
# Rollback only failed files (preserve good changes)
|
||||
npx claude-flow@alpha verify rollback --selective
|
||||
|
||||
# Rollback with automatic backup
|
||||
npx claude-flow@alpha verify rollback --backup-first
|
||||
|
||||
# Dry-run mode (preview without executing)
|
||||
npx claude-flow@alpha verify rollback --dry-run
|
||||
```
|
||||
|
||||
**Rollback Performance:**
|
||||
- Git-based rollback: <1 second
|
||||
- Selective file rollback: <500ms
|
||||
- Backup creation: Automatic before rollback
|
||||
|
||||
### Verification Reports
|
||||
|
||||
#### Generate Reports
|
||||
|
||||
Create detailed verification reports with metrics and visualizations.
|
||||
|
||||
**Report Formats:**
|
||||
```bash
|
||||
# JSON report
|
||||
npx claude-flow@alpha verify report --format json
|
||||
|
||||
# HTML report with charts
|
||||
npx claude-flow@alpha verify report --export metrics.html --format html
|
||||
|
||||
# CSV for data analysis
|
||||
npx claude-flow@alpha verify report --format csv --export metrics.csv
|
||||
|
||||
# Markdown summary
|
||||
npx claude-flow@alpha verify report --format markdown
|
||||
```
|
||||
|
||||
**Time-based Reports:**
|
||||
```bash
|
||||
# Last 24 hours
|
||||
npx claude-flow@alpha verify report --period 24h
|
||||
|
||||
# Last 7 days
|
||||
npx claude-flow@alpha verify report --period 7d
|
||||
|
||||
# Last 30 days with trends
|
||||
npx claude-flow@alpha verify report --period 30d --include-trends
|
||||
|
||||
# Custom date range
|
||||
npx claude-flow@alpha verify report --from 2025-01-01 --to 2025-01-31
|
||||
```
|
||||
|
||||
**Report Content:**
|
||||
- Overall truth scores
|
||||
- Per-agent performance metrics
|
||||
- Task completion quality
|
||||
- Verification pass/fail rates
|
||||
- Rollback frequency
|
||||
- Quality improvement trends
|
||||
- Statistical confidence intervals
|
||||
|
||||
### Interactive Dashboard
|
||||
|
||||
#### Launch Dashboard
|
||||
|
||||
Run interactive web-based verification dashboard with real-time updates.
|
||||
|
||||
```bash
|
||||
# Launch dashboard on default port (3000)
|
||||
npx claude-flow@alpha verify dashboard
|
||||
|
||||
# Custom port
|
||||
npx claude-flow@alpha verify dashboard --port 8080
|
||||
|
||||
# Export dashboard data
|
||||
npx claude-flow@alpha verify dashboard --export
|
||||
|
||||
# Dashboard with auto-refresh
|
||||
npx claude-flow@alpha verify dashboard --refresh 5s
|
||||
```
|
||||
|
||||
**Dashboard Features:**
|
||||
- Real-time truth score updates (WebSocket)
|
||||
- Interactive charts and graphs
|
||||
- Agent performance comparison
|
||||
- Task history timeline
|
||||
- Rollback history viewer
|
||||
- Export to PDF/HTML
|
||||
- Filter by time period/agent/score
|
||||
|
||||
### Configuration
|
||||
|
||||
#### Default Configuration
|
||||
|
||||
Set verification preferences in `.claude-flow/config.json`:
|
||||
|
||||
```json
|
||||
{
|
||||
"verification": {
|
||||
"threshold": 0.95,
|
||||
"autoRollback": true,
|
||||
"gitIntegration": true,
|
||||
"hooks": {
|
||||
"preCommit": true,
|
||||
"preTask": true,
|
||||
"postEdit": true
|
||||
},
|
||||
"checks": {
|
||||
"codeCorrectness": true,
|
||||
"security": true,
|
||||
"performance": true,
|
||||
"documentation": true,
|
||||
"bestPractices": true
|
||||
}
|
||||
},
|
||||
"truth": {
|
||||
"defaultFormat": "table",
|
||||
"defaultPeriod": "24h",
|
||||
"warningThreshold": 0.85,
|
||||
"criticalThreshold": 0.75,
|
||||
"autoExport": {
|
||||
"enabled": true,
|
||||
"path": ".claude-flow/metrics/truth-daily.json"
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
#### Threshold Configuration
|
||||
|
||||
**Adjust verification strictness:**
|
||||
```bash
|
||||
# Strict mode (99% accuracy required)
|
||||
npx claude-flow@alpha verify check --threshold 0.99
|
||||
|
||||
# Lenient mode (90% acceptable)
|
||||
npx claude-flow@alpha verify check --threshold 0.90
|
||||
|
||||
# Set default threshold
|
||||
npx claude-flow@alpha config set verification.threshold 0.98
|
||||
```
|
||||
|
||||
**Per-environment thresholds:**
|
||||
```json
|
||||
{
|
||||
"verification": {
|
||||
"thresholds": {
|
||||
"production": 0.99,
|
||||
"staging": 0.95,
|
||||
"development": 0.90
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
### Integration Examples
|
||||
|
||||
#### CI/CD Integration
|
||||
|
||||
**GitHub Actions:**
|
||||
```yaml
|
||||
name: Quality Verification
|
||||
|
||||
on: [push, pull_request]
|
||||
|
||||
jobs:
|
||||
verify:
|
||||
runs-on: ubuntu-latest
|
||||
steps:
|
||||
- uses: actions/checkout@v3
|
||||
|
||||
- name: Install Dependencies
|
||||
run: npm install
|
||||
|
||||
- name: Run Verification
|
||||
run: |
|
||||
npx claude-flow@alpha verify check --json > verification.json
|
||||
|
||||
- name: Check Truth Score
|
||||
run: |
|
||||
score=$(jq '.overallScore' verification.json)
|
||||
if (( $(echo "$score < 0.95" | bc -l) )); then
|
||||
echo "Truth score too low: $score"
|
||||
exit 1
|
||||
fi
|
||||
|
||||
- name: Upload Report
|
||||
uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: verification-report
|
||||
path: verification.json
|
||||
```
|
||||
|
||||
**GitLab CI:**
|
||||
```yaml
|
||||
verify:
|
||||
stage: test
|
||||
script:
|
||||
- npx claude-flow@alpha verify check --threshold 0.95 --json > verification.json
|
||||
- |
|
||||
score=$(jq '.overallScore' verification.json)
|
||||
if [ $(echo "$score < 0.95" | bc) -eq 1 ]; then
|
||||
echo "Verification failed with score: $score"
|
||||
exit 1
|
||||
fi
|
||||
artifacts:
|
||||
paths:
|
||||
- verification.json
|
||||
reports:
|
||||
junit: verification.json
|
||||
```
|
||||
|
||||
#### Swarm Integration
|
||||
|
||||
Run verification automatically during swarm operations:
|
||||
|
||||
```bash
|
||||
# Swarm with verification enabled
|
||||
npx claude-flow@alpha swarm --verify --threshold 0.98
|
||||
|
||||
# Hive Mind with auto-rollback
|
||||
npx claude-flow@alpha hive-mind --verify --rollback-on-fail
|
||||
|
||||
# Training pipeline with verification
|
||||
npx claude-flow@alpha train --verify --threshold 0.99
|
||||
```
|
||||
|
||||
#### Pair Programming Integration
|
||||
|
||||
Enable real-time verification during collaborative development:
|
||||
|
||||
```bash
|
||||
# Pair with verification
|
||||
npx claude-flow@alpha pair --verify --real-time
|
||||
|
||||
# Pair with custom threshold
|
||||
npx claude-flow@alpha pair --verify --threshold 0.97 --auto-fix
|
||||
```
|
||||
|
||||
### Advanced Workflows
|
||||
|
||||
#### Continuous Verification
|
||||
|
||||
Monitor codebase continuously during development:
|
||||
|
||||
```bash
|
||||
# Watch directory for changes
|
||||
npx claude-flow@alpha verify watch --directory src/
|
||||
|
||||
# Watch with auto-fix
|
||||
npx claude-flow@alpha verify watch --directory src/ --auto-fix
|
||||
|
||||
# Watch with notifications
|
||||
npx claude-flow@alpha verify watch --notify --threshold 0.95
|
||||
```
|
||||
|
||||
#### Monitoring Integration
|
||||
|
||||
Send metrics to external monitoring systems:
|
||||
|
||||
```bash
|
||||
# Export to Prometheus
|
||||
npx claude-flow@alpha truth --format json | \
|
||||
curl -X POST https://pushgateway.example.com/metrics/job/claude-flow \
|
||||
-d @-
|
||||
|
||||
# Send to DataDog
|
||||
npx claude-flow@alpha verify report --format json | \
|
||||
curl -X POST "https://api.datadoghq.com/api/v1/series?api_key=${DD_API_KEY}" \
|
||||
-H "Content-Type: application/json" \
|
||||
-d @-
|
||||
|
||||
# Custom webhook
|
||||
npx claude-flow@alpha truth --format json | \
|
||||
curl -X POST https://metrics.example.com/api/truth \
|
||||
-H "Content-Type: application/json" \
|
||||
-d @-
|
||||
```
|
||||
|
||||
#### Pre-commit Hooks
|
||||
|
||||
Automatically verify before commits:
|
||||
|
||||
```bash
|
||||
# Install pre-commit hook
|
||||
npx claude-flow@alpha verify install-hook --pre-commit
|
||||
|
||||
# .git/hooks/pre-commit example:
|
||||
#!/bin/bash
|
||||
npx claude-flow@alpha verify check --threshold 0.95 --json > /tmp/verify.json
|
||||
|
||||
score=$(jq '.overallScore' /tmp/verify.json)
|
||||
if (( $(echo "$score < 0.95" | bc -l) )); then
|
||||
echo "❌ Verification failed with score: $score"
|
||||
echo "Run 'npx claude-flow@alpha verify check --verbose' for details"
|
||||
exit 1
|
||||
fi
|
||||
|
||||
echo "✅ Verification passed with score: $score"
|
||||
```
|
||||
|
||||
### Performance Metrics
|
||||
|
||||
**Verification Speed:**
|
||||
- Single file check: <100ms
|
||||
- Directory scan: <500ms (per 100 files)
|
||||
- Full codebase analysis: <5s (typical project)
|
||||
- Truth score calculation: <50ms
|
||||
|
||||
**Rollback Speed:**
|
||||
- Git-based rollback: <1s
|
||||
- Selective file rollback: <500ms
|
||||
- Backup creation: <2s
|
||||
|
||||
**Dashboard Performance:**
|
||||
- Initial load: <1s
|
||||
- Real-time updates: <100ms latency (WebSocket)
|
||||
- Chart rendering: 60 FPS
|
||||
|
||||
### Troubleshooting
|
||||
|
||||
#### Common Issues
|
||||
|
||||
**Low Truth Scores:**
|
||||
```bash
|
||||
# Get detailed breakdown
|
||||
npx claude-flow@alpha truth --verbose --threshold 0.0
|
||||
|
||||
# Check specific criteria
|
||||
npx claude-flow@alpha verify check --verbose
|
||||
|
||||
# View agent-specific issues
|
||||
npx claude-flow@alpha truth --agent <agent-name> --format json
|
||||
```
|
||||
|
||||
**Rollback Failures:**
|
||||
```bash
|
||||
# Check git status
|
||||
git status
|
||||
|
||||
# View rollback history
|
||||
npx claude-flow@alpha verify rollback --history
|
||||
|
||||
# Manual rollback
|
||||
git reset --hard HEAD~1
|
||||
```
|
||||
|
||||
**Verification Timeouts:**
|
||||
```bash
|
||||
# Increase timeout
|
||||
npx claude-flow@alpha verify check --timeout 60s
|
||||
|
||||
# Verify in batches
|
||||
npx claude-flow@alpha verify batch --batch-size 10
|
||||
```
|
||||
|
||||
### Exit Codes
|
||||
|
||||
Verification commands return standard exit codes:
|
||||
|
||||
- `0`: Verification passed (score ≥ threshold)
|
||||
- `1`: Verification failed (score < threshold)
|
||||
- `2`: Error during verification (invalid input, system error)
|
||||
|
||||
### Related Commands
|
||||
|
||||
- `npx claude-flow@alpha pair` - Collaborative development with verification
|
||||
- `npx claude-flow@alpha train` - Training with verification feedback
|
||||
- `npx claude-flow@alpha swarm` - Multi-agent coordination with quality checks
|
||||
- `npx claude-flow@alpha report` - Generate comprehensive project reports
|
||||
|
||||
### Best Practices
|
||||
|
||||
1. **Set Appropriate Thresholds**: Use 0.99 for critical code, 0.95 for standard, 0.90 for experimental
|
||||
2. **Enable Auto-rollback**: Prevent bad code from persisting
|
||||
3. **Monitor Trends**: Track improvement over time, not just current scores
|
||||
4. **Integrate with CI/CD**: Make verification part of your pipeline
|
||||
5. **Use Watch Mode**: Get immediate feedback during development
|
||||
6. **Export Metrics**: Track quality metrics in your monitoring system
|
||||
7. **Review Rollbacks**: Understand why changes were rejected
|
||||
8. **Train Agents**: Use verification feedback to improve agent performance
|
||||
|
||||
### Additional Resources
|
||||
|
||||
- Truth Scoring Algorithm: See `/docs/truth-scoring.md`
|
||||
- Verification Criteria: See `/docs/verification-criteria.md`
|
||||
- Integration Examples: See `/examples/verification/`
|
||||
- API Reference: See `/docs/api/verification.md`
|
||||
Reference in New Issue
Block a user