172 lines
21 KiB
Plaintext
172 lines
21 KiB
Plaintext
|
a
|
|||
|
|
a>jâu ã @ s¤ d Z ddlmZmZmZmZmZ ddlmZm Z ddl
|
|||
|
|
m
|
|||
|
|
Z
|
|||
|
|
ddl m Z ddl
|
|||
|
|
Z
|
|||
|
|
ddlZG dd„ dee ƒZeG d d
|
|||
|
|
„ d
|
|||
|
|
ƒƒZG d d „ d ƒZd
|
|||
|
|
d„ Zedkr eƒ dS )a˜
|
|||
|
|
Global Reality Model
|
|||
|
|
Continuously learning global intelligence platform where every observation,
|
|||
|
|
every action, and every outcome improves models for all similar environments.
|
|||
|
|
|
|||
|
|
The platform IS the product. Apps, websites, APIs, and AI models are just
|
|||
|
|
interfaces to the same shared knowledge model and domain logic.
|
|||
|
|
|
|||
|
|
Architecture Principle:
|
|||
|
|
- Single shared ontology (IOM)
|
|||
|
|
- Single shared semantic understanding (Semantic Graph)
|
|||
|
|
- Single shared AI reasoning (all engines)
|
|||
|
|
- Single shared data structures (all models)
|
|||
|
|
- Single shared architectural foundation
|
|||
|
|
|
|||
|
|
No code is developed in isolation.
|
|||
|
|
Every line of code contributes to the evolution of the entire platform.
|
|||
|
|
é )ÚDictÚListÚOptionalÚTupleÚAny)Ú dataclassÚfield)Údatetime)ÚEnumNc @ s e Zd ZdZdZdZdZdZdS )Ú
|
|||
|
|
KnowledgeTypez5Four types of knowledge in the Reality Knowledge BaseÚ observationÚ relationshipZdecisionÚoutcomeN)Ú__name__Ú
|
|||
|
|
__module__Ú __qualname__Ú__doc__Z OBSERVATIONZ RELATIONSHIPZDECISIONZOUTCOME© r r úH/home/bernt/.openclaw/workspace/iom/intelligence/global_reality_model.pyr s
|
|||
|
|
r c @ sŠ e Zd ZU dZeed< eed< eed< eed< eed< ee ed< e eef ed< e
|
|||
|
|
eef ed < e e d
|
|||
|
|
�Z
|
|||
|
|
ee ed < e
|
|||
|
|
d œd
|
|||
|
|
d„ZdS )ÚRealityPatternz0A discovered pattern in the global reality modelÚ
|
|||
|
|
pattern_idÚ pattern_typeÚ descriptionÚ
|
|||
|
|
confidenceÚevidence_countÚ locationsÚ
|
|||
|
|
time_rangeÚmetrics)Údefault_factoryÚrelated_patterns©Úreturnc
|
|||
|
|
C s0 | j | j| jt| jdƒ| j| j| j| j| j dœ S )Né ) r r r r r r r r r )
|
|||
|
|
r r r Úroundr r r r r r ©Úselfr r r Úto_dict1 s
|
|||
|
|
÷zRealityPattern.to_dictN)r r r r ÚstrÚ__annotations__ÚfloatÚintr r r r Úlistr r& r r r r r $ s
|
|||
|
|
r c @ sd e Zd ZdZdd„ Zeedœdd„Zeedœdd „Zeeed
|
|||
|
|
œd d „Z eed
|
|||
|
|
œdd„Z
|
|||
|
|
eed
|
|||
|
|
œdd„Z eed
|
|||
|
|
œdd„Z eed
|
|||
|
|
œdd„Z
|
|||
|
|
eed
|
|||
|
|
œdd„Zeedœdd„Zeedœd d „Zeeed œd d „Zeeed!œd"d#„Zeee dœd$d%„Zed&œd'd(„Zeed)œd*d+„Zed,œd-d.„Zeee d/œd0d1„Zeeee d!œd2d3„Zed4œd5d6„Z ed4œd7d8„Z d9S ):ÚGlobalRealityModelu„
|
|||
|
|
Global Reality Model — The core intelligence layer
|
|||
|
|
|
|||
|
|
Every new observation, every completed action, and every measured outcome
|
|||
|
|
improves the models for ALL similar environments worldwide.
|
|||
|
|
|
|||
|
|
This is NOT just a digital twin of one city.
|
|||
|
|
This is a global knowledge system that continuously learns which
|
|||
|
|
interventions work best under different conditions.
|
|||
|
|
c C sT i | _ i | _i | _i | _i | _i | _i | _i | _d| _d| _ d| _
|
|||
|
|
t ¡
|
|||
|
|
¡ | _d S )Nr )Úobservation_knowledgeÚrelationship_knowledgeÚdecision_knowledgeÚoutcome_knowledgeÚpatternsZ
|
|||
|
|
pattern_indexÚlocation_fingerprintsÚtransfer_modelsÚtotal_observationsÚtotal_interventionsÚtotal_outcomesr ÚutcnowÚ isoformatÚ last_updater$ r r r Ú__init__K s zGlobalRealityModel.__init__)r r! c C s€ | dd¡}|| jvr g | j|< | j| |¡ | jd7 _| ||¡ | |¡}| |¡ t ¡ ¡ | _
|
|||
|
|
d|t |ƒ| jdœS )z‡
|
|||
|
|
Ingest a new observation into the global model
|
|||
|
|
Every observation improves understanding for similar locations
|
|||
|
|
Ú location_idÚunknowné Úingested)Ústatusr; Ú new_patternsr4 ) Úgetr- Úappendr4 Ú _update_location_fingerprintÚ"_extract_patterns_from_observationÚ_update_transfer_modelsr r7 r8 r9 Úlen)r% r r; r@ r r r Úingest_observationb s
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
üz%GlobalRealityModel.ingest_observation)r r! c C sˆ | dd¡}| dd¡}|| jvr,g | j|< | j| |¡ | jd7 _| ||¡ | |¡ | |¡ t ¡ ¡ | _
|
|||
|
|
d|d| jdœS )zy
|
|||
|
|
Ingest an intervention outcome
|
|||
|
|
Every outcome improves recommendations for ALL similar locations
|
|||
|
|
Ú action_typer< r; r= r> T)r? rH Z global_effectiveness_updatedr6 ) rA r0 rB r6 Ú _update_global_effectivenessÚ!_strengthen_patterns_with_outcomerE r r7 r8 r9 )r% r rH r; r r r Úingest_outcome� s
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
üz!GlobalRealityModel.ingest_outcome)Ú
|
|||
|
|
query_typeÚparamsr! c C sl |dkr| |¡S |dkr$| |¡S |dkr6| |¡S |dkrH| |¡S |dkrZ| |¡S dd|› �iS dS ) a(
|
|||
|
|
Query the global reality model
|
|||
|
|
|
|||
|
|
Examples:
|
|||
|
|
- "Which interventions work best for safety in residential areas?"
|
|||
|
|
- "What is the typical outcome of tree planting in Nordic cities?"
|
|||
|
|
- "Which locations are most similar to Stockholm City Center?"
|
|||
|
|
Úintervention_effectivenessÚlocation_similarityÚpattern_searchÚtransfer_learningÚ
|
|||
|
|
global_trendsÚerrorzUnknown query type: N)Ú!_query_intervention_effectivenessÚ_query_location_similarityÚ_query_patternsÚ_query_transfer_learningÚ_query_global_trends)r% rL rM r r r Úquery¡ s
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
zGlobalRealityModel.query)rM r! c C s" | d¡}| d¡}| d¡}| j |g ¡}g }|D ]6}|r`| j | d¡i ¡}| d¡|kr`q4| |¡ q4|s||dddœS td d
|
|||
|
|
„ |D ƒƒ} i }
|
|||
|
|
|D ]<}| d i ¡ ¡ D ]&\} } | |
|
|||
|
|
vrÂg |
|
|||
|
|
| < |
|
|||
|
|
| | ¡ qªq–d d
|
|||
|
|
„ |
|
|||
|
|
¡ D ƒ}
|
|||
|
|
|t|ƒt| t|ƒ d dƒ|
|
|||
|
|
tdt|ƒd ƒ||dœdœS )z-Query effectiveness of interventions globallyrH Ú
|
|||
|
|
location_typeÚ climate_zoner; Útyper z$No evidence yet for these conditions)rH r Úmessagec s s | ]}| d ¡dv rdV qdS ©r? )ÚsuccessÚpartialr= N©rA ©Ú.0Úor r r Ú <genexpr>Ò s ÿzGGlobalRealityModel._query_intervention_effectiveness.<locals>.<genexpr>Ú
|
|||
|
|
actual_changec S s( i | ] \}}|t t|ƒt|ƒ d ƒ“qS )r" )r# ÚsumrF )rc ÚmÚvr r r Ú
|
|||
|
|
<dictcomp>Ü ó zHGlobalRealityModel._query_intervention_effectiveness.<locals>.<dictcomp>éd r= ç®Gáz®ï?)rZ r[ )rH r Ú success_rateÚaverage_effectsr Z
|
|||
|
|
applies_to) rA r0 r2 rB rg ÚitemsrF r# Úmin)r% rM rH rZ r[ ÚoutcomesZfilteredr Zloc_fpÚ
|
|||
|
|
success_countZ avg_changesÚmetricÚchangeÚ avg_effectsr r r rT · sB
|
|||
|
|
|
|||
|
|
|
|||
|
|
ýþúz4GlobalRealityModel._query_intervention_effectivenessc C s¤ | d¡}| j |i ¡}|s$ddiS g }| j ¡ D ]F\}}||krDq2| ||¡}|dkr2| |t|dƒ| ||¡dœ¡ q2|jdd„ d d
|
|||
|
|
� ||d d … t|ƒd
|
|||
|
|
œS )z%Find locations similar to a referenceÚreference_location_idrS z Reference location not foundgffffffæ?é )r; Ú
|
|||
|
|
similarityZshared_patternsc S s | d S )Nry r ©Úxr r r Ú<lambda> rk z?GlobalRealityModel._query_location_similarity.<locals>.<lambda>T©ÚkeyÚreverseNé
|
|||
|
|
)Úreference_locationÚsimilar_locationsZ
|
|||
|
|
total_similar) rA r2 rp Ú!_calculate_fingerprint_similarityrB r# Ú_find_shared_patternsÚsortrF )r% rM Z reference_idZ reference_fpÚ similaritiesr; Ú fingerprintry r r r rU ê s(
|
|||
|
|
|
|||
|
|
ý
|
|||
|
|
|
|||
|
|
ýz-GlobalRealityModel._query_location_similarityc C sš | d¡}| d¡}| dd¡}g }| j ¡ D ]B\}}|rF|j|krFq.|rV||jvrVq.|j|k rbq.| | ¡ ¡ q.|jdd„ dd� t |ƒ|d d
|
|||
|
|
… d œS ) z'Search for patterns in the global modelr rt Úmin_confidenceç à?c S s | d S )Nr r rz r r r r| rk z4GlobalRealityModel._query_patterns.<locals>.<lambda>Tr} Né )Úpatterns_foundr1 )
|
|||
|
|
rA r1 rp r r r rB r& r… rF )r% rM r rt rˆ Úresultsr Úpatternr r r rV s
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
þz"GlobalRealityModel._query_patternsc
|
|||
|
|
C s² | d¡}| d¡}| d¡}| || j |i ¡ d¡dœ¡}| ||¡}|| dd¡ }i }| di ¡ ¡ D ]\} }
|
|||
|
|
t|
|
|||
|
|
| d ƒ|| < qn|||t|d
|
|||
|
|
ƒt|d
|
|||
|
|
ƒ|| d d¡d œS )
|
|||
|
|
z#Query transfer learning predictionsÚsource_location_idÚtarget_location_idrH r\ ©rH rZ r r ro r" rx r )Úsource_locationÚtarget_locationrH ry Útransfer_confidenceÚpredicted_effectsZsource_evidence)rA rT r2 Ú _calculate_location_similarityrp r# ) r% rM r‘ r’ rH Zsource_effectivenessry r“ Zadjusted_effectsrt Úeffectr r r rW ! s(
|
|||
|
|
|
|||
|
|
|
|||
|
|
þ
|
|||
|
|
ùz+GlobalRealityModel._query_transfer_learningc
|
|||
|
|
s& | d¡‰ | dd¡}g }| j ¡ D ]ˆ\}}|s2q$‡ fdd„|D ƒ}t|ƒdk rRq$‡ fdd„|D ƒ}|d |d tt|d ƒd
|
|||
|
|
ƒ d }| |t|dƒ|d t|ƒd œ¡ q$|jd
|
|||
|
|
d„ dd� |ràt dd„ |D ƒƒt|ƒ } nd } ˆ |t|ƒt| dƒtdd„ |D ƒƒtdd„ |D ƒƒ|dd… dœS )z(Query global trends across all locationsrt Ú time_periodZ1yc s g | ]}ˆ | d i ¡v r|‘qS ©r ra rb ©rt r r Ú
|
|||
|
|
<listcomp>L rk z;GlobalRealityModel._query_global_trends.<locals>.<listcomp>r" c s g | ]}|d ˆ ‘qS r˜ r rb r™ r r rš Q rk éÿÿÿÿr r= rl )r; Ú
|
|||
|
|
trend_percentÚ
|
|||
|
|
current_valueÚobservation_countc S s t | d ƒS )Nrœ )Úabsrz r r r r| \ rk z9GlobalRealityModel._query_global_trends.<locals>.<lambda>Tr} c s s | ]}|d V qdS )rœ Nr ©rc Útr r r re ` rk z:GlobalRealityModel._query_global_trends.<locals>.<genexpr>c S s g | ]}|d dkr|‘qS )rœ é r r r r r rš i rk c S s g | ]}|d dk r|‘qS )rœ éûÿÿÿr r r r r rš j rk Nr€ )rt r— Úlocations_trackedÚglobal_average_trendÚ trending_upÚ
|
|||
|
|
trending_downZ
|
|||
|
|
top_trends)
|
|||
|
|
rA r- rp rF ÚmaxrŸ rB r# r… rg )
|
|||
|
|
r% rM r— Útrendsr; Ú observationsZ
|
|||
|
|
metric_obsÚvaluesÚtrendZ avg_trendr r™ r rX @ s:
|
|||
|
|
&ü
|
|||
|
|
|
|||
|
|
ùz'GlobalRealityModel._query_global_trends)r; r c C sº || j vr4|| dd¡| dd¡i ddddœ| j |< | j | }|d d7 < | d i ¡ ¡ D ]H\}}||d
|
|||
|
|
vr~g |d
|
|||
|
|
|< |d
|
|||
|
|
| || d t ¡ ¡ ¡d œ¡ q^| |¡|d
|
|||
|
|
< dS )z,Update location fingerprint from observationrZ r< r[ r Ú )r; r\ r[ Úmetrics_historyrž Zintervention_countÚfingerprint_hashrž r= r r® Ú timestamp)Úvaluer° r¯ N)r2 rA rp rB r r7 r8 Ú_compute_fingerprint_hash)r% r; r Úfprt r± r r r rC n s&
|
|||
|
|
|
|||
|
|
|
|||
|
|
ù
|
|||
|
|
|
|||
|
|
þ
|
|||
|
|
z/GlobalRealityModel._update_location_fingerprint)r‡ r! c C sl | di ¡}i }| ¡ D ]*\}}|rtdd„ |D ƒƒt|ƒ ||< qtj|dd�}t | ¡ ¡ ¡ dd… S )z$Compute hash of location fingerprintr® c s s | ]}|d V qdS )r± Nr )rc Úhr r r re ‘ rk z?GlobalRealityModel._compute_fingerprint_hash.<locals>.<genexpr>T)Ú sort_keysNr€ )
|
|||
|
|
rA rp rg rF ÚjsonÚdumpsÚhashlibÚmd5ÚencodeÚ hexdigest)r% r‡ r Z
|
|||
|
|
avg_valuesrt ÚhistoryZ
|
|||
|
|
hash_inputr r r r² Š s z,GlobalRealityModel._compute_fingerprint_hash)Úfp1Úfp2r! c C sþ | di ¡}| di ¡}|r |s$dS t| ¡ ƒt| ¡ ƒ@ }|sDdS g }g }|D ]@}|| rP|| rP| || d d ¡ | || d d ¡ qP|sšdS tdd„ t||ƒD ƒƒ} tdd„ |D ƒƒd }
|
|||
|
|
td d„ |D ƒƒd } |
|
|||
|
|
d
|
|||
|
|
ksî| d
|
|||
|
|
kròdS | |
|
|||
|
|
| S ) z6Calculate similarity between two location fingerprintsr® g r› r± c s s | ]\}}|| V qd S ©Nr )rc ÚaÚbr r r re ¯ rk zGGlobalRealityModel._calculate_fingerprint_similarity.<locals>.<genexpr>c s s | ]}|| V qd S r¿ r )rc rÀ r r r re ° rk r‰ c s s | ]}|| V qd S r¿ r )rc rÁ r r r re ± rk r )rA ÚsetÚkeysrB rg Úzip) r% r½ r¾ Zmetrics1Zmetrics2Zcommon_metricsZvalues1Zvalues2rt Ú dot_productZ
|
|||
|
|
magnitude1Z
|
|||
|
|
magnitude2r r r rƒ – s* z4GlobalRealityModel._calculate_fingerprint_similarity)Úloc1Úloc2r! c C s( | j |i ¡}| j |i ¡}| ||¡S )z*Calculate similarity between two locations)r2 rA rƒ )r% rÆ rÇ r½ r¾ r r r r• ¸ s z1GlobalRealityModel._calculate_location_similarityc
|
|||
|
|
C sœ g }| di ¡}d|v r˜d|v r˜dt| jƒ› �}t|dddd| d d
|
|||
|
|
¡g| d t ¡ ¡ ¡| d t ¡ ¡ ¡f|d |d d œd
|
|||
|
|
�}|| j|< | |¡ |S )z*Extract patterns from a single observationr Ú safety_indexÚlighting_qualityzPAT-Ú correlationz'Safety correlates with lighting qualityg333333ã?r= r; r< r° ©rÈ rÉ )r r r r r r r r )rA rF r1 r r r7 r8 rB )r% r r@ r r r� r r r rD ¾ s* þþõ
|
|||
|
|
|