Skip to content
trendoviz

Tag

Global Inference Gateway

1 published trend · vote, save or discuss any of them

  1. AI Tools & ProductsNew7D: Insufficient history

    SageMaker HyperPod adds global inference routing

    Amazon SageMaker HyperPod has introduced the Global Inference Gateway, a managed endpoint that routes requests across registered HyperPod clusters within one AWS Region or across Regions. The service adds cluster selection and automatic failover above the existing per-cluster Inference Gateway, which continues selecting model pods.

    Published

    53 out of 100
    7D
    +100%
    Signals
    1
    Indep. src
    1
    Confidence
    Unconfirmed