HYjHdZddlmZddlZddlZddlZddlZddlZddlmZm Z ddl m Z e dZ e dz Z e dz Zed d ed z Ze d z Zd ZddZddZddZd dZd!dZedkreedS)"a9Continuous Hermes one-shot worker for XAUUSD hybrid M5 OHLCV collection only. The parent process never reads or prints raw OHLCV. Each child run must save raw bars straight into hybrid/data/ohlcv_M5.json and return only a compact statistical/progress summary, so the parent/current chat only receives summaries. ) annotationsN)datetimetimezone)Pathz9/home/aryy/.hermes/profiles/finance/backtests/xauusd_2026zhybrid/collector_state.jsonzhybrid/reportsT)parentsexist_okzm5_collector.logzhybrid/m5_collector.locka You are Aryy Finance M5 data collector. Process exactly ONE pending XAUUSD M5 OHLCV chunk for the hybrid backtest, save raw data to file, summarize via Python/statistics only, then stop. Project directory: /home/aryy/.hermes/profiles/finance/backtests/xauusd_2026 Collector state: hybrid/collector_state.json Scope: M5 ONLY. Do not collect M15/D/H4/M30/H1/W. Do not run scanner/backtest. Do not write trades/candidates/reviews. Critical privacy/context rule from Aryy: - Do NOT include raw OHLCV bars in the final answer. - Save raw bars to hybrid/data/ohlcv_M5.json. - Send back only summary statistics/progress: chunk id, range, kept bar count, output total bars, first/last output time, remaining M5 chunks, and any concise error. Process: 1. Read hybrid/collector_state.json. 2. Find the first chunk where suffix='M5' and (status='pending' OR status='failed' with attempts < 3). 3. If no such M5 chunk exists, update collector_state.status_m5='complete' and final response 'M5 COMPLETE' with output total bars only. 4. Use TradingView MCP only: - chart_set_symbol OANDA:XAUUSD - chart_set_timeframe chunk.timeframe - chart_set_visible_range from=chunk.from to=chunk.to - data_get_ohlcv count=500 summary=false 5. Keep only bars with numeric time inside chunk.from..chunk.to plus one M5 tolerance (300 sec). Discard unrelated bars. 6. Merge kept bars into hybrid/data/ohlcv_M5.json. Preserve existing bars, dedupe by numeric time, sort ascending. Schema: {"metadata":{"symbol":"XAUUSD","timeframe":"M5","source":"tradingview_mcp_visible_range_chunks","start":"2026-01-01","end":"2026-07-17","bar_count":N,"first_time":...,"last_time":...,"last_updated":"UTC ISO"},"bars":[{"time":int,"timestamp":"UTC ISO","open":float,"high":float,"low":float,"close":float,"volume":number|null}]} 7. Update the chunk: attempts += 1, bars_collected = kept bar count, status='done' if kept bars > 0 else 'failed', last_error=null or concise reason. 8. Write/overwrite hybrid/reports/m5_processing_summary.json with statistical summary only: chunk counts, output bar count, first/last time, average/median range/body for saved M5 bars. Do this by Python script/terminal or equivalent, not by pasting raw bars. 9. Validate JSON for collector_state, ohlcv_M5.json (if exists), and m5_processing_summary.json with python3 -m json.tool. 10. Final response exactly one compact line, no raw bars. Hard rules: - Exactly ONE M5 chunk per child run. - Do not use execute_code. - Do not use screenshots/vision. - Do not analyze strategy. - Do not write data/journal.json, backtest-data, shadow-trades, candidates, or reviews. - If MCP returns no in-range bars, mark only that chunk failed and stop; do not loop. msgstrreturnNonec,tjtjd|}t |dt dd5}||dzddddS#1swxYwYdS)N T)flushazutf-8)encoding ) rnowrutc isoformatprintLOG_FILEopenwrite)r linefs &hybrid/scripts/run_m5_mcp_collector.pylogr@sl8<((2244 < zm5_complete..Vs, H H Hh40G0G!0G0G0Gr%r*c3HK|]}|ddkVdS)r-doneNr0r8s r zm5_complete..Ws1BB!AEE(OOv5BBBBBBr%)r1r5all)r'm5s r m5_completer@UsK H HUYYx,, H H HB 88 BBBrBBBBBBr%intcxtjttr^ t jtpd}n#t$ri}YnwxYwtdtd|ddSt t j tj tjtjdddz d } t%}t'|}td |t)|rtd d |d<tj tjd dd|d<t, t j |ddz td d S#t$r}td|Yd}~d Sd}~wwxYw|dz }td|tj}d|d<ddddddt4g}t7j|t;t|d d d }td!|j|j rEtd"|j dd#d$dz|j! rEtd%|j! dd#d$dz|jd kr[td&|j td S#t$r}td|Yd}~Sd}~wwxYwtEj#d# td w#t$r}td|Yd}~wd}~wwxYwxYw)'Nz{}z LOCK_EXISTS rz&; exiting to avoid duplicate M5 worker) started_atpid)indentrrTz M5_STATE zM5_COMPLETE all M5 chunks donecomplete status_m5) microsecondz+00:00Zm5_completed_at) missing_okzLOCK_REMOVE_ERROR r/zRUN_M5_CHUNK iteration=financeHERMES_PROFILEhermesz --providerzcustom:9routerz--modelzag/gemini-pro-agentz-zi)cwdenvtextcapture_outputtimeoutzHERMES_EXIT code=zSTDOUT z | i0zSTDERR z6STOP nonzero hermes exit; leaving state for inspection)$oschdirROOTLOCKexistsr r!r# Exceptionr write_textdumpsrrrrrgetpidr&r4r@replacer"unlinkenvironcopyPROMPT subprocessrunr returncodestdoutstripstderrtimesleep)payload iterationr'ctsexcrQcmdprocs rmainrqZsUHTNNN {{}} j!1!1!9T::GG   GGG  Q4 Q Q' Q Q QRRRqOODJhl8<.H.H.R.R.T.T]_]f]h]hiirstttw{{|||%,  LLEE""C !C!! " " "5!! 4555%/k"+3< +E+E+M+MZ[+M+\+\+f+f+h+h+p+pqy{~++'(  E!!#3t99#DY]gjkkkD 5DO55 6 6 6{  "" RI 1 1 3 3 ; ;D% H H PPQQQ{  "" RI 1 1 3 3 ; ;D% H H PPQQQ!##LMMM , KK4K ( ( ( ( , , , *S** + + + + + + + + , JqMMM= @ , KK4K ( ( ( ( , , , *S** + + + + + + + + ,s-A"" A10A1C!O2(H H,H''H,/E'O2N33 O=OOO22P94PP9 P6P1,P91P66P9__main__)r r r r )r r)r'rr r()r'rr r5)r rA)__doc__ __future__rr rUrcsysrirrpathlibrrWr" REPORT_DIRmkdirrrXrgrbrr&r4r@rq__name__ SystemExitr$r%rr{s~ #"""""  '''''''' t GHH ,, $ $ --- * * (($ H EGGIN))))CCCC /,/,/,/,d z *TTVV  r%