惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Y
Y Combinator Blog
The GitHub Blog
The GitHub Blog
Vercel News
Vercel News
D
DataBreaches.Net
MongoDB | Blog
MongoDB | Blog
H
Help Net Security
小众软件
小众软件
美团技术团队
T
The Blog of Author Tim Ferriss
爱范儿
爱范儿
D
Docker
Martin Fowler
Martin Fowler
大猫的无限游戏
大猫的无限游戏
博客园 - 聂微东
Blog — PlanetScale
Blog — PlanetScale
H
Hackread – Cybersecurity News, Data Breaches, AI and More
罗磊的独立博客
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
V
V2EX
S
SegmentFault 最新的问题
云风的 BLOG
云风的 BLOG
B
Blog
雷峰网
雷峰网
The Cloudflare Blog

Recent Announcements

Amazon EC2 X8i instances are now available in Europe (Paris) Amazon CloudWatch pipelines now supports drop and conditional processing AWS Deadline Cloud supports monitor creation in multiple regions Amazon CloudWatch pipelines introduces new compliance and governance capabilities Second-generation Amazon FSx for NetApp ONTAP is now available in four additional AWS commercial and AWS GovCloud (US) Regions AWS Billing and Cost Management Dashboards Now Supports Scheduled Email Delivery AWS RTB Fabric supports health checks for real-time bidding workloads AWS Backup extends Amazon FSx support to 5 additional AWS Regions and expands cross-Region and cross-account copy to 14 AWS Regions Amazon RDS now supports the latest CU and GDR updates for Microsoft SQL Server Amazon Timestream for InfluxDB Now Supports Customer-Defined Maintenance Windows Amazon Bedrock now supports cost allocation by IAM user and role Amazon OpenSearch Service supports Managed Prometheus and agent tracing Amazon S3 Lifecycle pauses actions on objects that are unable to replicate Amazon RDS Blue/Green Deployments now supports Amazon RDS Proxy AWS Marketplace announces the Discovery API for programmatic access to catalog data AWS Agent Registry for centralized agent discovery and governance is now available in Preview Amazon OpenSearch Serverless now supports Zstandard (zstd) codec for index compression AWS Private CA now supports customer managed permissions for cross-account sharing Amazon EC2 Capacity Manager now supports tag-based dimensions Amazon Route 53 Resolver endpoints now support DNS delegation for private hosted zones in AWS GovCloud (US) Regions SageMaker HyperPod now supports gang scheduling for distributed training workloads Amazon IVS 实时直播功能现已支持冗余摄取 Amazon EKS 托管节点组现在支持 EC2 Auto Scaling 暖池 Amazon Bedrock AgentCore 浏览器新增操作系统级交互功能 Amazon WorkSpaces Advisor now available for AI-powered troubleshooting Amazon OpenSearch Service now supports Graviton4 based i8ge instances Oracle Database@AWS is now available in twelve AWS Regions AWS Lambda expands response streaming support to all commercial AWS Regions AWS Cost Explorer launches Natural Language Query capabilities powered by Amazon Q Amazon Lightsail 现已在亚太地区(马来西亚)区域推出
Amazon EMR 现在正式支持 Apache Spark 4.0.2
Amazon Web Services · 2026-05-28 · via Recent Announcements

发布于: 2026年5月27日

Amazon EMR 现已在所有三种部署模式中都支持 Apache Spark 4.0.2。借助 Spark 4.0.2,您可以使用 ANSI SQL 和 VARIANT 数据类型更轻松地构建和维护数据管道,在行级或列级强制实施精细访问控制(FGAC),使用 Apache Iceberg v3 表格式增强合规性和治理框架,并借助增强的流式传输功能更快地部署新的实时应用程序。

借助 Spark 4.0.2,您可以构建数据管道,通过标准 ANSI SQL 支持,让更广泛的用户可以使用数据工程,而无需学习 Spark 专有语法。Spark 4.0.2 通过 VARIANT 数据类型原生支持 JSON 和半结构化数据,为处理不同格式的数据提供了灵活性。您可以在 Apache Spark 作业中,对 AWS Lake Formation 注册表的读取和写入操作强制执行精细访问控制(FGAC)。Apache Iceberg v3 表格式基于这些安全功能构建而成,提供了更强的交易保障并跟踪数据血统,从而创建了满足监管合规性所需的审计跟踪记录。增强的流控制功能简化了对复杂有状态操作的管理并改进了监控,使您能够更快地部署用于欺诈检测、个性化以及其他时间敏感型使用案例的实时应用程序。


Apache Spark 4.0.2 已在提供 EMR 的所有区域推出。如需升级现有 EMR 应用程序,您可以使用 Apache Spark 升级代理来加速升级。要了解有关 Amazon EMR 上的 Apache Spark 4.0.2 的更多信息,请参阅 Amazon EMR 发行说明;要开始使用这项功能,请通过 AWS 管理控制台创建一个使用 Spark 4.0.2 的 EMR 应用程序。