All news with #amazon athena tag

Amazon SageMaker Catalog Exports Asset Metadata to Iceberg

🔍 Amazon SageMaker Catalog now exports asset metadata as an Apache Iceberg table via Amazon S3 Tables, enabling teams to query catalog inventory with standard SQL without building custom ETL. The export includes technical fields (resource_id, resource_type), business metadata (asset_name, business_description), ownership details, and timestamps, partitioned by snapshot_date for time travel queries. The dataset appears in SageMaker Unified Studio and is queryable from Amazon Athena, Studio notebooks, AI agents, and BI tools. Available in all supported Regions at no additional SageMaker charge; you pay for S3 Tables storage and Athena queries.

Amazon Athena for Apache Spark Integrated with SageMaker

🚀 Amazon SageMaker now supports Amazon Athena for Apache Spark, combining a new notebook experience with a fast serverless Spark runtime in a single workspace. Data engineers, analysts, and data scientists can query data, run Python, develop jobs, train models, and visualize results with no infrastructure to manage and second-level billing. The service runs Spark 3.5.6, is optimized for Apache Iceberg and Delta Lake, and adds debugging, real-time Spark UI monitoring, and secure Spark Connect communication. Table-level access controls are enforced through AWS Lake Formation.

Amazon Athena adds per-query DPU controls for Capacity use

🔧 Amazon Athena now lets you control Data Processing Unit (DPU) allocation for queries running on Capacity Reservations at the workgroup or per-query level. You can set explicit DPU values so small queries consume less capacity while critical jobs receive guaranteed resources. The Athena console and API now report per-query DPU usage, improving visibility into consumption and supporting capacity planning. These controls reduce over-provisioning, manage concurrency, and improve predictability for business-critical workloads in supported AWS Regions.

Amazon Athena auto-scales Capacity Reservations with limits

🔁 Amazon Athena now provides an auto-scaling solution for Capacity Reservations that adjusts reserved DPUs automatically based on workload utilization. The solution uses AWS Step Functions to monitor Amazon CloudWatch metrics and add or remove DPUs when utilization crosses configured high and low thresholds. You can set measurement frequency, utilization thresholds, and capacity limits, and customize behavior via the provided CloudFormation template. The feature is available in Regions where Capacity Reservations is supported.

Amazon Athena adds SSO support for JDBC and ODBC drivers

🔐 Amazon Athena now supports single sign-on for its JDBC and ODBC drivers using AWS IAM Identity Center’s trusted identity propagation. With updated drivers (JDBC 3.6.0 and ODBC 2.0.5.0), analysts can connect from third‑party BI tools and SQL clients using corporate credentials while Lake Formation permissions are enforced and actions are logged. This removes the need for embedded credentials, simplifies identity‑based data governance, and streamlines access management across tools.