From Supply Chains to Financial Markets: Multi-Agent AI Systems for Real-Time Decision-Making
A practitioner who has managed global logistics through crises explains why no single AI model can handle real-world operational complexity, and how building a coordinated team of specialist agents, tested against live financial markets, unlocks real-time decision-making that compounds over time.
Where the idea came from
My background is in global supply chain and logistics. I have led intercontinental operations at a global automotive OEM and run ocean and air transport at a global furniture retailer across three continents.
These are not hypothetical examples for me. I have lived the chaos: rerouting shipments during the Red Sea crisis, keeping cargo moving at record volumes through COVID, consolidating regional operating models into one while the world was falling apart. Every day was a multi-variable decision problem where port congestion, carrier capacity, fuel prices, tariff announcements, and geopolitical risk all interact simultaneously and you cannot pause to wait for better data.
That experience shaped what I wanted to build. I knew exactly what a real-time decision system needed to handle: visual data (dashboards, vessel tracking, port imagery), unstructured text (regulatory news, market reports, carrier alerts across languages), and hard numerical computation (routing optimization, cost modeling, capacity planning), all fused together under time pressure.
But supply chains are slow to validate. A routing decision takes days or weeks to prove right or wrong. Financial markets gave me the same complexity but with a feedback loop measured in minutes, sometimes milliseconds, not months. So I built the architecture for supply chain complexity, and tested it where the feedback is fastest: live algorithmic trading.
Building a team of AIs
No single AI model handles all of this well. A vision model cannot do math. A language model cannot see charts. A quantitative engine cannot read the news. So I did not build one AI. I built a team of them.
The Observer. The first agent is a vision model. It receives live chart screenshots at multiple timeframes and describes what it sees: not interpret, not decide, just observe and return structured data as JSON. In a supply chain context, this is the agent watching satellite imagery of port congestion, reading vessel-density heatmaps, or scanning warehouse camera feeds for bottlenecks.
The Analyst. The second agent is a language model. It ingests thousands of real-time headlines from over 40 feeds across six categories, scores each for relevance and sentiment, and synthesizes the current narrative. For supply chains, this is the agent parsing regulatory changes across jurisdictions, monitoring carrier alerts in multiple languages, and connecting a tariff announcement in Washington to a container backlog in Rotterdam before your ops team has finished their morning coffee.
The Calculator. The third agent is not AI at all. It is pure deterministic math: technical indicators, statistical models, pattern detection. I learned the hard way that language models get math wrong in subtle ways. So all mathematical computation lives in traditional code. In logistics, this is routing optimization, cost modeling, lead-time calculation, inventory replenishment math.
These three streams feed a fusion layer that weights them, scores confidence, and produces a single structured decision with full reasoning attached.
Then it broke
The system's first live session, it executed over 30 trades. The win rate looked great. And it lost money. A threshold was set slightly too low, so technically profitable trades closed below the cost of the spread. A news filter triggered on low-impact events, silently rejecting good setups. The trailing stop kicked in too early, cutting winners short while letting losers run. None of these were AI problems. The plumbing around the models was broken in ways that only show up under live conditions.
This is the part nobody tells you about multi-agent systems: the AI is the easy part. I spent maybe 20% of my time on prompts and model selection. The other 80% was data-pipeline reliability, edge cases in the deterministic engine, infrastructure issues, and the hardest problem of all: feedback loops.
If you run operations, you have seen this before, not with AI agents, but with processes. A KPI looks green because the threshold is wrong. A routing rule saves money on paper but creates downstream delays nobody measures. Multi-agent AI has the same failure mode; it just fails faster, which means you also learn faster, if you are logging everything.
What made it work
The breakthroughs came from a few design choices.
Separate observation from decision-making. When the vision model both observed and decided, it saw what it wanted to see based on its own prediction bias. Splitting the observer from the decision-maker removed that bias. This is an organizational design principle too: it is why auditors should not report to the people they audit.
Enforce structured output everywhere. Every agent returns JSON with a defined schema: signal, confidence, reasoning, key driver. You cannot weight and combine free-text opinions. In supply-chain terms, this is why standardized KPIs across regions matter more than each region's custom report.
Build real-time pipelines, not batch reports. The system processes over 40 live feeds every cycle and logs everything (every observation, decision, and outcome), creating a feedback loop where the system's own history becomes training data. If your decision-making runs on yesterday's data, you are always reacting; if it runs on live data with a logged feedback loop, you are learning, and the difference compounds.
The moment it clicked
One night I woke and checked my phone. The system had been running on its own for hours: it had analyzed the charts, read the news, calculated the technicals, entered a position, managed the risk, and closed the trade in profit, all while I slept. That is the hard thing to build: not one smart model, but a system of specialists that coordinates reliably under uncertainty. And that is the hard thing to build in any organization too.
Beyond trading
The multi-agent pattern works anywhere you need real-time decisions from mixed data: medical imaging with patient history and lab results; satellite imagery with sensor data and weather feeds for agriculture; security cameras with access logs and threat intelligence. The next frontier is teaching the system to recognize not just what to decide, but when it is wrong about its own confidence.
What I learned
Build a team of specialist agents, not one model that tries to do everything. Separate observation from decision-making. Keep math in deterministic code and let AI handle reasoning, context, and pattern recognition. Accept early that the hard part will not be the AI; it will be the systems engineering around it. Structure every output, because you cannot fuse what you cannot measure. And log every decision and outcome, especially the embarrassing ones: that is where the real learning lives.
The real question: what decision in your business gets made every day based on mixed data from different sources, under time pressure, where no single person has the full picture? That is where a multi-agent system belongs, not generating text, but making decisions.
Key Takeaways
- No single AI model handles all data modalities well. Build specialist agents (vision, language, deterministic math) and coordinate them through a fusion layer rather than expecting one model to do everything.
- Separate observation from decision-making: when the same agent does both, prediction bias corrupts the data it sees, the same flaw that makes auditors ineffective when they report to those they audit.
- Enforce structured JSON output from every agent; you cannot weight, combine, or audit free-text opinions, and standardized schemas are what turn a collection of AIs into a real decision system.
- The AI is roughly 20% of the work; the other 80% is data-pipeline reliability, edge-case handling in deterministic code, and logging every decision and outcome to create compounding feedback loops.
- Real-time pipelines beat batch reports: if your system runs on yesterday's data you are always reacting; live data with a logged feedback loop means the system is always learning.
- The right question for any organization is: which daily decisions involve mixed data from multiple sources, time pressure, and no single person with the full picture? That is exactly where multi-agent AI belongs.
Originally published on LinkedIn
Book a free 30-minute working session.