How Databricks Unity Catalog Uses Storage Credentials to Secure AWS S3 Access

·1 views

As organisations adopt the Databricks Lakehouse Platform on AWS, Unity Catalog's Storage Credentials have become a core component for governing secure access to Amazon S3. Before Unity Catalog, Databricks relied on cluster-level instance profiles that gave all users identical S3 permissions with no isolation or centralised audit trail. Storage Credentials work by registering an AWS IAM Role within Unity Catalog, allowing Databricks to assume that role via AWS STS and enforce access at the directory level across S3 buckets. They are mandatory for Serverless SQL Warehouses and required before creating External Locations, making them essential for modern Databricks deployments. All S3 access routed through Storage Credentials is fully auditable via Unity Catalog's system audit logs, giving compliance teams clear visibility into who accessed which data and when.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Masked Call Routing: A Privacy-Safe Fix for Blocking Cars in Indian Cities

A common urban problem in Indian cities — strangers needing to contact a car owner blocking a driveway or gate — doubles as a compelling systems design challenge. The traditional solution of displaying a phone number on a windshield sticker exposes the owner's personal number permanently to anyone who sees it, including marketers and bad actors. A more robust approach uses masked call routing, similar to systems used by cab and delivery apps, where scanning a QR code on the vehicle triggers a server-side binding between a temporary virtual number and the owner's real number. The virtual number is leased for a short window, typically around ten minutes, after which the binding is torn down and the number returned to a shared pool. Key design considerations include correct pool sizing based on peak concurrency, strict one-to-one number bindings to prevent misdirected calls, and safeguards against potential harassment since the system effectively allows any stranger to make an owner's phone ring.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Vue 3 and pdf-lib Enable Fully Browser-Based PDF Watermarking Tool

A developer has detailed how to build a browser-based PDF watermarking tool using Vue 3, pdf-lib, and PDF.js, processing files entirely on the user's device without server uploads. The approach addresses privacy concerns associated with traditional watermark tools that send potentially sensitive documents to remote servers. The implementation covers text rendering, rotation correction, and multi-page support, including a mathematical fix to center rotated text accurately on each page. Configurable options such as font size, opacity, rotation angle, color, and page range are supported to suit different use cases. The full source code is available on GitHub, and the post notes that image-based watermarks using PNG logos would require a separate approach beyond pdf-lib's built-in text drawing methods.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Launches Free Open-Source Invoice Generator Requiring No Sign-Up

A developer named Vlad has released EasyInvoicePDF, a free and open-source tool for generating professional invoices. The project was created out of frustration with costly and overly complex invoicing software. The tool offers features including live PDF preview, instant download, customizable templates, and support for over 120 currencies and multiple languages. Users can save seller and buyer profiles and apply flexible tax options such as VAT and sales tax. The source code is publicly available on GitHub and the developer is actively welcoming feedback and feature suggestions.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How to Resolve 'Duplicate Class' Android Build Errors in React Native and Expo

React Native and Expo developers frequently encounter a 'Duplicate class' Gradle build error on Android, typically triggered after installing a new package, upgrading Expo, or changing a dependency. The error occurs when two different libraries include the same compiled Java or Kotlin class, causing Gradle to halt the build rather than guess which version to package. The root cause is usually not the library named in the error message, but a transitive dependency pulling in an older or incompatible version behind the scenes. Common culprits include version mismatches between libraries, outdated third-party packages referencing legacy AndroidX or Google Play Services versions, and manually added Android dependencies that Expo already manages internally. Recommended fixes include identifying the conflicting modules, running Gradle dependency insight commands to trace the source, updating outdated libraries, and clearing the Gradle cache before rebuilding.

0 comments Read more at DEV Community