All news with #data governance tag

🔁 Cloudflare introduces Redirects for AI Training, a toggle that turns existing rel="canonical" tags into HTTP 301 redirects for verified AI training crawlers. On paid Cloudflare plans this enforcement redirects AI crawler traffic (examples include GPTBot, ClaudeBot, Bytespider) to canonical URLs, preventing ingestion of deprecated content. Human visitors and other automated classes are unaffected.

☁️ Azure announces the general availability of smart tier for Blob and Data Lake Storage, a fully managed automated tiering service that continuously optimizes object placement across hot, cool, and cold tiers. It evaluates last-access timestamps—objects idle 30 days move to cool and after 60 more days move to cold—and promotes data back to hot on access. Enable during account creation or switch existing zonal accounts to start optimizing automatically.

🔍 Google outlines a set of curation accelerators within Google Data Cloud that automate cataloging, metadata enrichment, profiling, lineage, and pipeline generation to shorten time-to-insight. Key capabilities include Cloud Storage auto-discovery via Dataplex Universal Catalog, semantic metadata augmentation with Data Insights, automated data quality and lineage controls, and AI agents that generate ingestion and transformation code. The platform also provides built-in AI SQL functions, embeddings, and continuous queries to support multimodal and real-time curation. These features are designed to reduce manual ETL work so teams can focus on analysis, ML, and business decisions.

🛡️ Amazon CloudWatch pipelines introduces compliance and governance controls to help preserve data integrity and restrict pipeline creation. You can enable a keep original toggle to store raw logs before any transformation, and processed entries now include metadata indicating they were transformed. New IAM condition keys let administrators limit pipeline creation by log source and type. These capabilities are provided at no additional cost and are available in Regions where pipelines is supported.

📊 Google is reintroducing Data Studio (formerly Looker Studio) as the central home for Google Data Cloud assets, emphasizing unified access to reports, BigQuery conversational agents, and data apps built in Colab. The redesigned product will sit alongside Looker, targeted to personal, ad-hoc exploration while Looker remains the governed enterprise BI solution. A free edition continues to serve individuals and a Data Studio Pro tier offers AI, enterprise security, and management features; existing assets will be migrated transparently.

🧊 Google announced preview read/write interoperability between BigQuery and Iceberg-compatible engines via the Google-managed Iceberg REST Catalog. The capability lets BigQuery, Trino, Spark, Flink and others create, update, and query a single Iceberg table type while enforcing unified governance and table-level access controls. Customers can offload compaction and garbage collection to BigLake to reduce small-file and metadata bloat and improve query performance.

🔒 Google explains how it designed Gmail to protect user data as Gemini-powered features roll out. The company says Gemini is not trained on personal email content and only accesses messages for specific, isolated tasks like summarization. According to Gmail’s VP of product, Blake Barnes, the feature processes requests inside the inbox and does not retain the processed data.

🔍 This article introduces labs demonstrating how to prepare and use data stored in Google Cloud databases to support production-ready AI. It highlights semantic search using embeddings in AlloyDB and Cloud SQL (PostgreSQL and MySQL), multimodal image–text embeddings, and AlloyDB AI functions like on-the-fly semantic evaluation and reranking. It also covers NL2SQL generation via the alloydb_ai_nl extension and points to hands-on modules for moving from tests to production.

🔒 An independent Big 4 accounting firm has completed a fresh privacy examination of Cloudflare's 1.1.1.1 public DNS resolver and confirmed that its core privacy commitments remain in force. The report reaffirms that Cloudflare does not sell or share resolver users’ personal data or use it for advertising, and that source IP addresses are anonymized and deleted within 25 hours. The review also notes that up to 0.05% of randomly sampled packets may be inspected solely for network troubleshooting and attack mitigation, and clarifies that the examination scope focused exclusively on privacy assurances.

🔒 Digital assets left after death — from emails and social media to passwords and crypto wallets — can complicate an already traumatic time for families and create new fraud opportunities. The legal landscape is fragmented: RUFADAA in the US, a proposed UK bill and ELI efforts in Europe offer partial solutions, but platform policies remain inconsistent. Practical steps include creating a digital inventory, appointing legacy contacts (e.g., Facebook/Instagram Legacy Contact, Google Inactive Account Manager, Apple Digital Legacy) and using emergency access features in password managers. Also file tax returns, place deceased alerts on credit reports, cancel subscriptions, and be wary of scams targeting grieving relatives.

📚 OpenAI has begun rolling out a new ChatGPT Library feature that stores personal files and images in its cloud so they can be referenced in future chats. The feature is available to Plus, Pro, and Business subscribers worldwide except in the European Economic Area, Switzerland, and the United Kingdom. Files uploaded in chats or via the composer are saved by default to a secure, dedicated location and remain in the Library until manually deleted; deleting a chat does not remove the stored file.

📢 AWS Database Migration Service (DMS) Schema Conversion with GenAI is now available in nine additional AWS Regions, enabling local processing and helping meet data residency requirements. The feature leverages Amazon Bedrock foundation models — including Claude 3.5 Sonnet v2, Claude 3.7 Sonnet, and Claude Sonnet 4 — to automate schema and code conversion. It converts schemas and code from Oracle, SQL Server, MySQL, PostgreSQL, and Sybase to Amazon Aurora PostgreSQL-Compatible Edition and Amazon RDS for PostgreSQL, reducing manual effort and accelerating migrations. DMS Schema Conversion is available at no additional charge and can be accessed through the AWS Management Console or CLI.

🔐 Amazon Redshift now supports federated permissions with AWS IAM Identity Center (IdC) across multiple AWS Regions, letting you extend IdC from a primary Region to additional Regions for improved proximity-based performance and resilience. In those Regions you can create Redshift and Lake Formation Identity Center applications without replicating identities, so existing workforce identities can query warehouses while row-, column-level and masking controls continue to apply automatically. Users benefit from single sign-on access via Amazon QuickSight, the Redshift Query Editor, or third-party SQL tools, simplifying access and compliance across regions.

🧩 Microsoft outlined a strategy at FabCon and SQLCon 2026 to converge its database portfolio and Microsoft Fabric into a single, unified data platform. Key highlights include the new Database Hub (early access) for unified estate management across Azure SQL, Cosmos DB, PostgreSQL, MySQL, SQL Server via Arc, and Fabric Databases. The company also showcased enhancements to OneLake, Runtime 2.0, Fabric IQ, agent experiences, migration assistants, and a database savings plan that can reduce costs up to 35% for eligible scenarios.

🔎 Amazon SageMaker Unified Studio now supports custom metadata search filters, enabling teams to narrow catalog results using organization-specific attributes like business region, data classification, or study name. Filters accept string fields with a contains operator and numeric fields (Integer, Long) with equals, greater than, and less than operators. Users can also filter by asset name, description, and date range, combine multiple filters, and retain selections across browser sessions; the feature is available in all AWS Regions where Unified Studio is supported.

🔒 Microsoft announced new Purview innovations for Fabric to help organizations discover sensitive data risks, prevent oversharing, and improve governance and data quality across their data estate. Updates include general availability of DLP policies for Fabric Warehouses and KQL/SQL DBs, Insider Risk Management for lakehouses, and preview capabilities for Copilots and Agents. The Unified Catalog also gains publication workflows and data quality checks for ungoverned assets to better prepare trusted data for AI.

⚡ AWS Glue zero-ETL now supports configurable change data capture (CDC) refresh intervals and on-demand ingestion for Amazon DynamoDB sources. You can set refresh windows from 15 minutes up to 6 days, letting teams balance data freshness and cost, and trigger immediate ingestion for urgent updates. These enhancements align DynamoDB zero-ETL integrations with SaaS sources such as Salesforce, SAP, and ServiceNow. The capabilities are available today in all regions where zero-ETL is supported.

📡 Google Cloud and DigitalRoute are delivering reusable, cloud-native data pipelines that turn diverse telecom telemetry into AI-ready datasets. Running DigitalRoute’s Usage Engine Private Edition on GKE, the solution normalizes proprietary formats at edge and core, filters noise, and routes data into Spanner for real-time digital twins and BigQuery for large-scale analytics and training with Vertex AI. The result is consistent, contextualized subscriber traces that accelerate production-grade autonomous network use cases.

🔁 Amazon SageMaker Unified Studio now synchronizes catalog metadata and context with Atlan, Collibra, and Alation, aligning projects, assets, descriptions, glossary terms, and hierarchies across platforms. Collibra supports bidirectional synchronization and can manage SageMaker Unified Studio data access requests, while Atlan and Alation ingest metadata from SageMaker with additional enhancements planned. The Collibra integration is provided as an open-source solution on GitHub, and setup is performed by establishing connections from each partner to SageMaker Unified Studio.

🚀 Amazon SageMaker Unified Studio now supports AWS Glue 5.1 for Visual ETL, notebook, and code-based data processing jobs. With Glue 5.1 you can run on Apache Spark 3.5.6 with Python 3.11 and Scala 2.12.18, and use updated open table formats including Apache Iceberg 1.10.0, Apache Hudi 1.0.2, and Delta Lake 3.3.2. Select Glue 5.1 from the job version dropdown to apply the runtime across Visual ETL, notebooks, and code jobs.