All news with #data security tag

🚀 Amazon MSK Express brokers now deliver Apache Kafka data directly to Amazon S3 general purpose buckets, providing a fully managed, auto-scaling capability for high-throughput data delivery. This feature handles scaling, retries, and backpressure for mission-critical workloads and can reduce ingestion and delivery costs by up to 60% versus self-managed connectors. MSK Express supports throughput up to 10 GB/s to S3 and eliminates the need to provision additional broker egress throughput, simplifying operations and lowering infrastructure costs.

🧭 Today at Next Tokyo, Google Cloud announced enhancements to its borderless Lakehouse built on Apache Iceberg, enabling cross-cloud, zero-copy analytics and federated catalogs. The platform lets Gemini Enterprise and conversational agents query and act on live data across on-prem, AWS, Azure, and major SaaS systems without heavy ETL. New features include catalog federation (preview), Cross-Cloud Interconnects with predictable pricing, intelligent caching, and integration with Knowledge Catalog for unified governance and context.

🛠️ AWS DataSync Enhanced mode now supports agent-based transfers for HDFS, Microsoft Azure Blob Storage, and self-managed object storage, and agents can be deployed on Microsoft Hyper-V. Using a DataSync agent, customers can move data with Enhanced mode's parallelism, unlimited file counts, and detailed metrics. HDFS support includes multiple NameNode high-availability configurations and Transparent Data Encryption with Kerberos authentication for secure, compliant migrations.

🔄 AWS DataSync Enhanced mode now supports Amazon EFS and Amazon FSx for Lustre as source or destination locations. Enhanced mode provides parallel data processing, removes file count limits, and offers detailed transfer metrics to simplify large-scale migrations and high-performance workloads. This capability is available in all Regions where AWS DataSync is offered.

🛠️ AWS Glue Data Quality now supports anomaly detection for Catalog-based evaluations and can write evaluation results to AWS Glue Data Catalog (GDC) tables. These features apply to both ETL jobs and Catalog evaluations, enabling ML-driven time-series forecasting to surface unexpected changes in table statistics without manual thresholds. Evaluation outcomes, profiling metrics, and anomaly predictions (with confidence bounds) are persisted to GDC tables and can be queried via standard SQL. The capabilities are available in all AWS commercial regions and AWS GovCloud (US).

📊 AWS announced a Distribution Analyzer for AWS Glue Data Quality that produces frequency distribution profiles for datasets. The feature generates histograms for numeric columns and value distributions for categorical, date, and boolean columns, with support for custom bin counts to tune granularity. Distribution statistics integrate with existing DQDL rulesets, are stored in Amazon S3, and are accessible via APIs for querying and visualization.

🔒 Two-thirds of organizations have delayed or cancelled Microsoft Copilot deployments due to fears the AI assistant could expose confidential SharePoint data. CoreView’s State of Microsoft 365 Security and Governance 2026 report (21 July) highlights confusion over Copilot's access and permissions and widespread concerns about data leakage. C-level executives are most likely to pause rollouts, and respondents link hesitation to prior Microsoft 365 security incidents and missing foundational controls.

🔒 This post introduces the preview of IAM data governance tags for BigQuery column-level security. Built on Google Cloud Resource Manager tags with purpose=DATA_GOVERNANCE, these tags are global, support hierarchical classification up to five levels, and are replicated for disaster recovery. The article explains creating tag keys/values, attaching tags to columns via JSON or SQL, and defining regional BigQuery data policies for masking or raw access. It highlights decoupled governance, regional policy enforcement, and layered security requirements.

🔗 This post introduces the %%bqsql IPython cell magic and the BigFrames library to bridge Python (pandas) and BigQuery SQL within notebooks. It explains setup steps for local or Colab environments, how to enable the BigQuery sandbox, and how to load the bigframes extension. The article walks through a USDA wheat data example showing chained workflows that alternate between Python and BigQuery SQL, plus tips for schema handling and visualization.

🧩 AWS Clean Rooms now supports writing SQL query results to intermediate tables within a collaboration, enabling multi-step analytical workflows between partners. These intermediate tables allow reuse of complex joins and creation of shared ID mapping tables for downstream analyses, all within the collaboration’s privacy boundary. The feature helps reduce costs and improve performance for subsequent analyses such as reach, frequency, and attribution.

🔒 Wearables raise acute privacy concerns for professional athletes because biometric data can directly affect livelihoods. While such data can aid training and injury prevention, access by coaches, teams, or leagues risks misuse in discipline, contract negotiations, and betting markets. Experts warn commercialization could enable gamblers and teams to exploit sensitive signals like sleep or heart rate, and aging or injured players may be most vulnerable. Legal and ethical safeguards remain unresolved.

🚀 Amazon Bedrock Managed Knowledge Base is now generally available as a fully managed retrieval-augmented generation (RAG) service. The offering removes the need to manage vector databases, data pipelines, and retrieval infrastructure by handling ingestion, storage optimization, and advanced retrieval. It supports six native connectors—S3, SharePoint, Confluence, Google Drive, OneDrive, and a web crawler—with automatic syncing and managed vector storage tuned for price-performance. Native integration with Amazon Bedrock AgentCore provides auto-generated permissions and observability for agent deployments.

🔐 AWS Lake Formation now allows reading and writing the underlying Amazon S3 data files for tables registered in the AWS Glue Data Catalog, unifying permissions for SQL and direct file access. It issues temporary, scoped credentials tied to Lake Formation table grants—SELECT for read and SUPER for read/write—and is supported in Amazon EMR 7.13+. You can use Spark or Trino with provided APIs or an open source plugin, and all activity is logged in AWS CloudTrail. This capability is available at no extra charge in supported Regions.

🆕 Amazon Aurora DSQL now supports the PostgreSQL JSONB data type with optional compression. You can create or modify tables to store semi-structured data such as configuration metadata, API parameters, and event logs alongside relational data. With PostgreSQL compression enabled by default, larger JSONB payloads are stored more efficiently to help reduce storage costs. Get started with Aurora DSQL via the AWS Free Tier and check Regional availability in the AWS Region table.

🔒 Children face lasting identity and privacy risks online from school accounts, gaming profiles, apps and devices. These data can be exploited for fraud or synthetic identity creation, often remaining undetected for years. Parents, schools and vendors all share responsibility; practical steps include data minimization, strong passwords, MFA, privacy settings, parental controls and credit freezes.

📈 BigQuery Graph enables building a digital twin of interconnected systems like supply chains and restaurant networks by creating a Graph View over existing tables. The approach maps items, recipes, locations and dependencies into nodes and edges, enabling targeted queries for issues such as recalls, weather disruptions, or procurement leaks. It emphasizes keeping relational data for metrics while using graphs for structure, cleaning keys, and capturing edge properties for richer modeling.

📢 Amazon Simple Email Service (Amazon SES) now supports tenant-level suppression lists to isolate bounces and complaints per tenant. Previously, a single suppression list applied to all tenants in an account, which could cause one tenant's delivery issues to affect others. Administrators can choose suppression scope (TENANT or ACCOUNT) and reason filters (BOUNCE, COMPLAINT, or both). API operations with a TenantName parameter let you view and manage suppressed addresses.

📊 Connected Sheets removes CSV exports and turns Google Sheets into a live, secure interface to BigQuery, enabling business users to analyze petabytes of governed data without SQL. Admins retain security and governance by provisioning table or view access while preventing data alteration from Sheets. End users gain immediate agility using familiar tools like pivot tables, charts, and formulas to analyze billions of rows and create refreshable reports and hybrid models. Connecting requires a Google Workspace account and a billing-enabled Google Cloud project, with connections established either from Sheets or the BigQuery UI.

📊 Cloudflare built Town Lake, a lakehouse-style unified data analytics platform, and Skipper, an AI data agent, to make its vast telemetry and logs queryable and auditable. Town Lake combines Trino, Iceberg on R2, a metadata catalog, PII scanning, access control, and ELT tooling to provide fresh, accurate, and governed data. Skipper lets non-SQL users ask natural-language questions, produce correct SQL-backed answers, and create shareable charts and dashboards.

🔍 Data security posture management (DSPM) tools help security teams locate shadow data across cloud and on-premises systems to reduce data loss risk. These products focus on data discovery, classification, mapping, and risk assessment, complementing CSPM and other security platforms. The market has seen heavy M&A as vendors expand integrations and AI capabilities to address evolving cloud, AI, and hybrid data risks.