docs: LandveX Intelligence Lab specification v1.0
- Internal development environment for Control Intelligence - Core principle: 'Produces verified Control Intelligence, not AI models' - Separate repo: landvex-intelligence-lab - Navigation: Dashboard, Models, Datasets, Annotations, Training, Evaluation, Decision Cases, Replay, Validation, Deploy, Settings - Key features: - Dashboard: AI status (models, datasets, jobs, cases) - Mission Replay: click through entire chain - Annotation: video + AI suggestion + manual correction - Decision Cases: first-class objects, all playable - Benchmark: compare YOLO, Grounding DINO, SAM, custom models - Replay: find regressions between model versions - Validation: field trials, scenario tests, decision tests - Deploy: 'Promote Model' not 'Deploy' (dev → validation → pilot → prod) - Experiments: link EP-1.0, DS-001, etc. to real data - Target: New AI engineer understands in minutes: 'This is where we build, test, and verify LandveX Control Intelligence before anything reaches production.' Rationale: Single internal tool for all AI development. Centralizes model training, annotation, validation, replay, decision chains, regression tests, experiments, and model promotion.
This commit is contained in:
@@ -0,0 +1,239 @@
|
|||||||
|
# LANDVEX INTELLIGENCE LAB
|
||||||
|
|
||||||
|
**Internal Development Environment for Control Intelligence**
|
||||||
|
|
||||||
|
| | |
|
||||||
|
|---|---|
|
||||||
|
| **Version** | 1.0 |
|
||||||
|
| **Status** | SPECIFICATION |
|
||||||
|
| **Purpose** | Build, test, and verify LandveX Control Intelligence before production |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Core Principle
|
||||||
|
|
||||||
|
**LandveX Intelligence Lab does not produce AI models. It produces verified Control Intelligence.**
|
||||||
|
|
||||||
|
This is an internal tool. Never a customer product.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Repository
|
||||||
|
|
||||||
|
```
|
||||||
|
landvex-intelligence-lab
|
||||||
|
```
|
||||||
|
|
||||||
|
Separate from:
|
||||||
|
- `quixzoom-app`
|
||||||
|
- `landvex-web`
|
||||||
|
- `aamos-core`
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Navigation
|
||||||
|
|
||||||
|
```
|
||||||
|
Dashboard
|
||||||
|
├── Models
|
||||||
|
├── Datasets
|
||||||
|
├── Annotations
|
||||||
|
├── Training
|
||||||
|
├── Evaluation
|
||||||
|
├── Decision Cases
|
||||||
|
├── Replay
|
||||||
|
├── Validation
|
||||||
|
├── Deploy (Promote Model)
|
||||||
|
└── Settings
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Dashboard
|
||||||
|
|
||||||
|
Shows AI status, not business data.
|
||||||
|
|
||||||
|
```
|
||||||
|
┌─────────────────────────────────────┐
|
||||||
|
│ Models │
|
||||||
|
│ Detection v12 │
|
||||||
|
│ Segmentation v5 │
|
||||||
|
│ OCR v3 │
|
||||||
|
│ Decision Model v1.0 │
|
||||||
|
├─────────────────────────────────────┤
|
||||||
|
│ Datasets │
|
||||||
|
│ Roads, Buildings, Signs │
|
||||||
|
│ Vegetation, Drainage │
|
||||||
|
├─────────────────────────────────────┤
|
||||||
|
│ Training Jobs │
|
||||||
|
│ Running: 2 │
|
||||||
|
│ Queued: 1 │
|
||||||
|
│ Failed: 0 │
|
||||||
|
│ Completed: 47 │
|
||||||
|
├─────────────────────────────────────┤
|
||||||
|
│ Decision Cases │
|
||||||
|
│ Validated: 23 │
|
||||||
|
│ Pending: 5 │
|
||||||
|
│ Rejected: 2 │
|
||||||
|
└─────────────────────────────────────┘
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Mission Replay
|
||||||
|
|
||||||
|
Click through the entire chain:
|
||||||
|
|
||||||
|
```
|
||||||
|
Video → Frame → Bounding boxes → Detected objects → Evidence → Finding → Decision → Business Impact
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Annotation
|
||||||
|
|
||||||
|
```
|
||||||
|
┌─────────┬─────────────┬──────────────┐
|
||||||
|
│ Video │ AI Suggestion│ Manual │
|
||||||
|
│ │ │ Correction │
|
||||||
|
├─────────┼─────────────┼──────────────┤
|
||||||
|
│ │ Object: │ Correct? │
|
||||||
|
│ │ Road Crack │ YES / NO │
|
||||||
|
│ │ Confidence: │ │
|
||||||
|
│ │ 82% │ Severity: │
|
||||||
|
│ │ │ Low / Medium │
|
||||||
|
│ │ │ / High │
|
||||||
|
└─────────┴─────────────┴──────────────┘
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Decision Case
|
||||||
|
|
||||||
|
First-class objects:
|
||||||
|
|
||||||
|
```
|
||||||
|
Case #4232
|
||||||
|
├── Reality
|
||||||
|
├── Observation
|
||||||
|
├── Evidence
|
||||||
|
├── Finding
|
||||||
|
├── Decision
|
||||||
|
├── Outcome
|
||||||
|
└── Learning
|
||||||
|
```
|
||||||
|
|
||||||
|
All cases playable.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Benchmark
|
||||||
|
|
||||||
|
Compare models:
|
||||||
|
|
||||||
|
| Model | Precision | Recall | F1 | Latency | Decision Accuracy |
|
||||||
|
|-------|-----------|--------|----|---------|-------------------|
|
||||||
|
| YOLO v8 | 0.89 | 0.87 | 0.88 | 45ms | — |
|
||||||
|
| Grounding DINO | 0.91 | 0.85 | 0.88 | 120ms | — |
|
||||||
|
| SAM | 0.88 | 0.90 | 0.89 | 200ms | — |
|
||||||
|
| Custom | 0.92 | 0.91 | 0.915 | 60ms | 0.87 |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Replay
|
||||||
|
|
||||||
|
Find regressions:
|
||||||
|
|
||||||
|
```
|
||||||
|
Mission 213
|
||||||
|
├── Play
|
||||||
|
├── Show AI
|
||||||
|
├── Show Human Annotation
|
||||||
|
├── Differences
|
||||||
|
├── New Model
|
||||||
|
└── Old Model
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Validation
|
||||||
|
|
||||||
|
```
|
||||||
|
Field Trials
|
||||||
|
Scenario Tests
|
||||||
|
Decision Tests
|
||||||
|
Evidence Tests
|
||||||
|
Golden Failures
|
||||||
|
Regression Tests
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Deploy (Promote Model)
|
||||||
|
|
||||||
|
```
|
||||||
|
Development → Validation → Pilot → Production
|
||||||
|
```
|
||||||
|
|
||||||
|
Not "Deploy". "Promote Model".
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Experiments
|
||||||
|
|
||||||
|
```
|
||||||
|
Experiments
|
||||||
|
├── EP-1.0
|
||||||
|
├── DS-001
|
||||||
|
├── DS-002
|
||||||
|
├── DS-003
|
||||||
|
├── Field Trials
|
||||||
|
└── Metrics
|
||||||
|
```
|
||||||
|
|
||||||
|
Link experiment protocol to real development and validation data.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## What This Tool Collects
|
||||||
|
|
||||||
|
- Model training
|
||||||
|
- Annotation
|
||||||
|
- Datasets
|
||||||
|
- Replay
|
||||||
|
- Decision chains
|
||||||
|
- Validation
|
||||||
|
- Regression tests
|
||||||
|
- Experiments
|
||||||
|
- Model promotion
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## New Developer Experience
|
||||||
|
|
||||||
|
A new AI engineer should open the repo and within minutes understand:
|
||||||
|
|
||||||
|
**"This is the tool where we build, test, and verify LandveX Control Intelligence before anything reaches production."**
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Relationship to Principles
|
||||||
|
|
||||||
|
- All development in Git
|
||||||
|
- All experiments reproducible
|
||||||
|
- All models traceable from training to validation to production
|
||||||
|
- Version control and traceability
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## ändringshistoria
|
||||||
|
|
||||||
|
| Version | Datum | Beskrivning |
|
||||||
|
|---------|-------|-------------|
|
||||||
|
| 1.0 | 2026-07-02 | Initial specification for LandveX Intelligence Lab |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## STATUS
|
||||||
|
|
||||||
|
**SPECIFICATION — Awaiting development decision**
|
||||||
Reference in New Issue
Block a user