Redundancy & Growth Planning¶
AI workloads create new resilience requirements that traditional enterprise networks are not designed for. A legacy network survives a link failure with a 30-second failover and some degraded performance. An AI contact centre with 500 agents loses ₹2–5 lakhs per minute of AI downtime during peak hours. Redundancy requirements are fundamentally different.
Redundancy design principles for AI networks¶
Principle 1 — Size each path for 100%, not 50%¶
In an active-active dual-path design, each path must carry the full AI load independently:
If B_recommended = 10 Gbps and you have two 10G paths, you normally carry 5 Gbps on each. If one path fails, the surviving path must handle 10 Gbps. Both paths must be sized for this scenario.
50% sizing causes AI outage on failover
A design that sizes each path at 50% of B_recommended will saturate the surviving path the moment failover occurs. All AI calls will fail. This is the most common enterprise AI network resilience mistake.
Principle 2 — Failover must complete in under 10 seconds¶
Traditional routing failover (OSPF reconvergence) takes 30–60 seconds. During that window, all AI inference calls timeout. For AI contact centres, 30-second failover is unacceptable.
Required failover technologies:
| Technology | Failover time | Suitable for |
|---|---|---|
| BFD + OSPF | 1–3 seconds | Campus core failover |
| SD-WAN active-active | < 1 second | WAN path failover |
| BGP with BFD | 2–5 seconds | Multi-homed internet |
| FHRP (HSRP/VRRP) | 3–10 seconds | Default gateway failover |
| Campus edge AI failover | 5–15 seconds | Tier 3 pod redundancy |
Principle 3 — AI inference pods need N+1 redundancy¶
A single GPU inference pod serving 500 agents is a single point of failure. If the pod fails, all 500 agents lose AI assist simultaneously. Design for N+1:
Where Pod_capacity is the number of effective load units each pod can serve.
Principle 4 — Model weights must be cached locally¶
If the model registry is cloud-hosted and the internet fails, campus-edge pods cannot load new models or restart from a cold state. Cache model weights on local NVMe storage at each site. Model cache = model size × number of production models × 2 (primary + previous version).
Redundancy design worksheet¶
Complete for each site:
| Redundancy element | Current design | Target design | Gap |
|---|---|---|---|
| WAN paths | ___ | Active-active dual paths | ___ |
| Per-path bandwidth | ___ | B_recommended (full load) | ___ |
| WAN failover time | ___ | < 1 second (SD-WAN) | ___ |
| Campus core redundancy | ___ | Dual core switches, ECMP | ___ |
| Core failover time | ___ | < 3 seconds (BFD+OSPF) | ___ |
| Inference pod count | ___ | N+1 minimum | ___ |
| Model weight cache | ___ | Local NVMe, all models | ___ |
| NGFW redundancy | ___ | Active-active HA pair | ___ |
| DNS redundancy | ___ | Dual resolvers, anycast | ___ |
Growth planning¶
The 18-month rule¶
Enterprise AI deployments typically expand from pilot (10% of agents) to full deployment (100%) within 12–18 months. Infrastructure procured for the pilot is almost never adequate for full deployment. Plan for full deployment from day one.
Growth-adjusted bandwidth:
B_growth = B_recommended × Growth_buffer
| Timeline to full deployment | Buffer |
|-----------------------------|--------|
| No planned expansion | 1.0× |
| 20% growth in 12 months | 1.2× |
| 2× in 18 months | 2.0× |
| Full greenfield, unknown | 2.5× |
AI model size growth¶
Models are growing in size rapidly. A deployment sized for a 7B model today may need to serve a 13B or 30B model in 18 months. Plan storage and network accordingly:
For a site expecting to run a 13B model (26 GB FP16) with 3 models, keeping 2 versions each, with 50% growth buffer:
U_eff growth projection¶
Calculate U_eff at each deployment milestone and verify IS remains below 3 at each stage:
| Milestone | H | AI | IoT | Pod | U_eff | IS at current B | Action |
|---|---|---|---|---|---|---|---|
| Today | ___ | ___ | ___ | ___ | ___ | ___ | ___ |
| 6 months | ___ | ___ | ___ | ___ | ___ | ___ | ___ |
| 12 months | ___ | ___ | ___ | ___ | ___ | ___ | ___ |
| 18 months | ___ | ___ | ___ | ___ | ___ | ___ | ___ |
| Full deployment | ___ | ___ | ___ | ___ | ___ | ___ | ___ |
Scalability checklist¶
Before approving an AI network design, verify these scalability properties:
- B_recommended calculated at full planned deployment headcount
- Each WAN path sized to carry 100% of B_recommended independently
- Inference pod count = CEIL(U_eff / Pod_capacity) + 1 (N+1)
- Model weight storage sized for largest anticipated model × 2 versions × 1.5 growth buffer
- IS < 3 verified at full deployment U_eff, not pilot U_eff
- Core switch port density sufficient for full agent floor capacity
- QoS policy templates deployed and tested at partial load before full rollout
- SD-WAN failover tested with full AI load on surviving path
- Campus-edge AI pods tested in single-pod failure scenario
- Growth buffer applied: B_recommended × 1.5 minimum