AI / ML

Higgsfield is an open-source framework combining GPU workload management with machine learning capabilities for training massive models. It provides fault-tolerant orchestration and supports ZeRO-3 DeepSpeed and PyTorch fully sharded data parallel APIs. The system handles exclusive and non-exclusive resource allocation to enable efficient scaling for billions to trillions of parameters.

• Built for fault-tolerant, highly scalable GPU orchestration across clusters.
• Supports ZeRO-3 DeepSpeed and PyTorch FSDP for efficient model sharding.
• Manages both exclusive and non-exclusive compute resource allocation.
• Designed specifically for training LLMs with billions to trillions of parameters.

Amazon SageMaker AI now allows users to submit prioritized lists of instance types for training and processing jobs instead of specifying a single instance. The service automatically selects the first available capacity from the provided list, significantly reducing wait times for high-demand GPUs. This update removes the need for complex custom retry logic or concurrent job submissions to secure compute resources during peak periods.

• Submit prioritized instance lists to let SageMaker auto-select available capacity.
• Eliminate custom retry logic previously required for GPU availability.
• Reduce job scheduling latency during peak compute demand periods.
• Simplify job definitions by removing the need for multiple concurrent submissions.