惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Apple Machine Learning Research
Apple Machine Learning Research
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
G
Google Developers Blog
博客园 - 司徒正美
J
Java Code Geeks
aimingoo的专栏
aimingoo的专栏
A
About on SuperTechFans
博客园 - 三生石上(FineUI控件)
WordPress大学
WordPress大学
T
The Blog of Author Tim Ferriss
D
Docker
大猫的无限游戏
大猫的无限游戏
D
DataBreaches.Net
腾讯CDC
V
Visual Studio Blog
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
C
Check Point Blog
M
MIT News - Artificial intelligence
Jina AI
Jina AI
I
InfoQ
雷峰网
雷峰网
The Cloudflare Blog
美团技术团队
Engineering at Meta
Engineering at Meta

Recent Announcements

Amazon EC2 X8i instances are now available in Europe (Paris) Amazon CloudWatch pipelines now supports drop and conditional processing AWS Deadline Cloud supports monitor creation in multiple regions Amazon CloudWatch pipelines introduces new compliance and governance capabilities Second-generation Amazon FSx for NetApp ONTAP is now available in four additional AWS commercial and AWS GovCloud (US) Regions AWS Billing and Cost Management Dashboards Now Supports Scheduled Email Delivery AWS RTB Fabric supports health checks for real-time bidding workloads AWS Backup extends Amazon FSx support to 5 additional AWS Regions and expands cross-Region and cross-account copy to 14 AWS Regions Amazon RDS now supports the latest CU and GDR updates for Microsoft SQL Server Amazon Timestream for InfluxDB Now Supports Customer-Defined Maintenance Windows Amazon Bedrock now supports cost allocation by IAM user and role Amazon OpenSearch Service supports Managed Prometheus and agent tracing Amazon S3 Lifecycle pauses actions on objects that are unable to replicate Amazon RDS Blue/Green Deployments now supports Amazon RDS Proxy AWS Marketplace announces the Discovery API for programmatic access to catalog data AWS Agent Registry for centralized agent discovery and governance is now available in Preview Amazon OpenSearch Serverless now supports Zstandard (zstd) codec for index compression AWS Private CA now supports customer managed permissions for cross-account sharing Amazon EC2 Capacity Manager now supports tag-based dimensions Amazon Route 53 Resolver endpoints now support DNS delegation for private hosted zones in AWS GovCloud (US) Regions SageMaker HyperPod now supports gang scheduling for distributed training workloads Amazon IVS 实时直播功能现已支持冗余摄取 Amazon EKS 托管节点组现在支持 EC2 Auto Scaling 暖池 Amazon Bedrock AgentCore 浏览器新增操作系统级交互功能 Amazon WorkSpaces Advisor now available for AI-powered troubleshooting Amazon OpenSearch Service now supports Graviton4 based i8ge instances Oracle Database@AWS is now available in twelve AWS Regions AWS Lambda expands response streaming support to all commercial AWS Regions AWS Cost Explorer launches Natural Language Query capabilities powered by Amazon Q Amazon Lightsail 现已在亚太地区(马来西亚)区域推出
SageMaker JumpStart 现在为基础模型提供优化部署
Amazon Web Services · 2026-04-17 · via Recent Announcements

SageMaker JumpStart 现在提供优化部署,使客户能够使用针对特定使用案例和性能限制量身定制的预配置设置来部署基础模型。SageMaker JumpStart 优化部署通过提供任务感知配置来简化模型部署,这些配置可根据您的工作负载要求(无论是内容生成、汇总还是问答)来优化成本、吞吐量或延迟。此次发布包括对来自 Meta、Microsoft、Mistral AI、Qwen、Google 和 TII 的 30 多种热门模型的支持,并允许在部署前查看 P50 延迟、首次令牌签发时间(TTFT)和吞吐量等关键绩效指标。

借助 SageMaker JumpStart 优化部署,客户可以从特定使用案例配置(例如生成式写作或聊天式交互)中进行选择,并选择包括成本优化、吞吐量优化、延迟优化或平衡性能在内的优化目标。模型使用预设配置部署到 SageMaker AI 托管推理端点或 SageMaker HyperPod 集群,让客户无需猜测,同时保持对部署细节的全面了解。可用模型包括 Meta Llama 3.1 和 3.2 变体、Microsoft Phi-3、包括全新 Mistral-Small-24B-Instruct-2501 的 Mistral AI 模型、包括多模态 Qwen2-VL 的 Qwen 2 和 3 系列、Google Gemma 和 TII Falcon3。所有部署都利用 SageMaker 的 VPC 部署功能,确保数据控制和生产就绪基础设施具有企业级安全性。该功能适用于目前支持 SageMaker JumpStart 的所有 AWS 区域。

要开始使用优化部署,请导航到 SageMaker Studio 中的“模型”,在“JumpStart 模型”选项卡中选择所需的基础模型,选择“部署”,然后选择您的使用案例和性能优化目标。有关详细信息,请访问 SageMaker JumpStart 文档。AWS 正在积极扩大支持范围,以纳入更多模型。