OffNet Newsroom

Daily topic roundup

AWS

Friday, August 07, 2026 · 8 stories, curated & summarized — click any story for the source.

Amazon ElastiCache now supports Graviton4-based M8g, R8g, and C8gn node families for both Valkey and Memcached engines. These new instances deliver up to 47% higher throughput and 43% lower P99 latency compared to Graviton3 equivalents, with up to 31% better price-performance. The M8g family specifically offers 20% more memory at the same node size, while C8gn nodes provide up to 200 Gbps of network bandwidth for network-intensive workloads.

  • Graviton4 nodes boost throughput by 47% and cut P99 latency by 43% over Graviton3.
  • M8g nodes provide 20% more memory at identical sizes (e.g., 124 GiB vs 103 GiB).
  • C8gn nodes offer 200 Gbps bandwidth, optimizing cost for network-heavy loads.
  • Support spans both Valkey and Memcached engines for immediate compatibility.
COMPARISONGraviton4 vs Graviton3 PerformanceThroughput Increase47%Latency Reduction43%Price-Performance Gain31%
Hacker News (100+ points) general

AMD acquires Taalas to etch AI models directly into silicon

AMD has acquired Taalas, a startup specializing in hardware-accelerated inference, to enhance performance by embedding AI models directly into silicon structures. This move aims to reduce latency and power consumption for inference workloads by bypassing traditional software execution layers. The acquisition signals a strategic shift toward custom silicon solutions for high-efficiency AI deployment.

  • AMD targets inference efficiency by moving model execution closer to hardware level.
  • Acquisition suggests focus on reducing latency and power for large language models.
  • Custom silicon approach may differentiate AMD in competitive AI chip market.
  • Practitioners should monitor for new hardware acceleration features in AMD's roadmap.

Amazon ECS now allows fractional GPU allocation on EC2 G6f instances, supporting partitions as small as one-eighth of an NVIDIA L4 Tensor Core GPU with 3 GB of memory. Users can specify GPU resources like 0.125, 0.25, or 0.5 in task definitions to right-size containers for lightweight AI inference, experimentation, or rendering tasks. This capability helps reduce infrastructure costs by avoiding the need to provision full GPU instances for smaller workloads.

  • Request fractional GPUs (0.125, 0.25, 0.5) directly in ECS task definitions.
  • Enables right-sizing for small-model AI inference and graphics rendering.
  • Reduces costs by avoiding full GPU instance provisioning for light workloads.
  • Supports NVIDIA L4 Tensor Core GPUs with minimum 3 GB memory allocation.
BY THE NUMBERSThe headline number3GBECS supports fractional GPU scheduling on G6f instances…

Microsoft has launched a public preview of a dedicated AI Gateway tier within Azure API Management, shifting the control plane focus from traditional APIs to models, MCP servers, and tools. This new layer consolidates access to major providers like Foundry, Bedrock, Vertex AI, and OpenAI through a single endpoint, utilizing policy cards instead of XML configurations. While architects appreciate the consolidation, there are open questions regarding the precise boundaries of governance within this architecture.

  • Unified endpoint fronts Foundry, Bedrock, Vertex AI, and OpenAI for simplified routing.
  • Control plane shifts from API-centric to model and MCP server-centric governance.
  • Policy configuration uses cards instead of traditional XML, reducing complexity.
  • Governance boundaries between AI traffic and standard API traffic remain unclear.

Amazon EC2 G7 instances powered by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs are now available in the Europe (Spain) Region. These instances deliver up to 4.6x AI inference performance and 2.1x graphics performance compared to the previous G6 generation. They are optimized for AI model deployment, real-time graphics rendering, and GPU-accelerated data analytics workloads.

  • G7 instances in Spain offer up to 4.6x AI inference performance over G6.
  • Powered by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs.
  • Accelerates graphics, video transcoding, and spatial computing workloads.
  • Supports AI inference for translation, image analysis, and RAG systems.
COMPARISONG7 vs G6 Performance GainsAI Inference4.6xGraphics2.1x

AWS Backup for Amazon S3 now allows you to create S3 Access Points for recovery points, enabling immediate read-only access to backup data without triggering a full restore. This feature supports standard S3 operations like GetObject and ListObjectsV2 for both snapshot and continuous recovery points. It facilitates targeted file recovery, data validation, and forensic investigations while keeping the data secured in standard or air-gapped vaults.

  • Skip full restores for targeted file recovery using S3 Access Points.
  • Access backup data via standard APIs like GetObject and ListObjectsV2.
  • Supports snapshot and point-in-time recovery points in any vault type.
  • Enables compliance auditing and forensic investigation without data exposure.
HOW IT WORKSDirect S3 Backup Access1Create S3 Access Point2Attach to Recovery Point3Read Data via API
AWS What's New awsdatabase

Amazon Quick adds multi-dataset topics for runtime joins

Amazon Quick now supports multi-dataset topics, allowing users to model relationships across multiple datasets within a single topic. This eliminates the need for pre-joining data into a single source, which previously consumed extra SPICE capacity and required manual data preparation. The new relational model performs joins at runtime, enabling natural language Q&A and dashboard building without rebuilding datasets for different use cases.

  • Define relationships once per topic; joins execute at runtime rather than during data prep.
  • Reduces SPICE capacity consumption by avoiding redundant pre-joined datasets.
  • Enables natural language Q&A and dashboarding across related datasets without manual SQL joins.
  • Simplifies model maintenance when underlying data structures or use cases change.
HOW IT WORKSQuick Multi-Dataset Workflow1Define relationships in topic2Join data at runtime3Query with natural language4Build dynamic dashboards

AWS Glue Data Catalog now allows you to export technical and business metadata, including glossary terms and custom attachments, directly into S3 Tables. This preview feature writes data in Apache Iceberg format to the managed aws-catalog bucket, enabling external querying, auditing, and time travel capabilities. Additionally, the semantic search preview has expanded to support catalogs encrypted with AWS KMS customer managed keys.

  • Export Glue catalog metadata to S3 Tables for external querying and auditing.
  • Metadata is stored in Apache Iceberg format to enable time travel queries.
  • Semantic search preview now supports KMS customer managed key encryption.
  • Use this feature to bridge catalog metadata with table-level data tools.
HOW IT WORKSExporting Catalog Metadata1Extract Glue catalog metadata2Include glossary terms3Write to S3 Tables4Use Iceberg format