SShortSingh.
Back to feed

Snowflake, BigQuery, Redshift or Databricks: billing model matters most for warehouse choice

0
·26 views

A guide for data engineers and tech leads notes that for standard BI and reporting, all four cloud warehouses perform adequately. The longer-term cost drivers are how each vendor bills, which cloud ecosystem a team is tied to, and how much tuning effort is required. BigQuery's on-demand pricing charges by data scanned, so unpartitioned tables can get expensive quickly, while Snowflake and Databricks penalize idle compute, making auto-suspend and right-sizing important. The article recommends a team's existing cloud footprint, workload type, and skill set as the deciding factors, and advises running real queries on realistic data and comparing total monthly cost, not just unit prices. It also warns against lift-and-shift migrations, skipping validation, and forgetting the BI layer, and notes that Apache Iceberg support lets several engines share data.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Court Rules Fourth Amendment Does Not Cover AI-Generated Probable Cause

A court has reportedly ruled that the Fourth Amendment's protections do not extend to probable cause determinations generated by artificial intelligence. The decision was highlighted in a Techdirt report published on November 19, 2026. The source material offers limited detail beyond the headline and linked discussion, so specifics about the case and its parties are not available. The ruling raises questions about how constitutional search and seizure standards apply when law enforcement relies on AI tools.

0
ProgrammingDEV Community ·

Unpatched VMware vCenter zero-day exploited by Chinese APT group

A critical, unpatched remote code execution flaw in VMware vCenter was actively exploited in a zero-day campaign attributed to a sophisticated Chinese advanced persistent threat group. Because vCenter serves as the central management plane for virtualised infrastructure, a compromise could expose every system it manages, including databases, domain controllers, and backup systems. The vulnerability requires no valid credentials and can run commands with root or SYSTEM privileges, allowing attackers to potentially gain full control of a virtual environment. The article argues that such a flaw demands emergency out-of-band response rather than standard patch cycles, along with pre-authorised mitigation paths and detection controls. Recommended steps include applying vendor patches immediately, isolating hosts and rotating credentials if no fix exists, and restricting management-plane access to trusted administrative sources.

0
ProgrammingDEV Community ·

Physical AI Requires Hardware and Software Co-Design, Says STATERA Library Chapter

Physical AI systems cannot be treated as models separate from their physical platforms, since perception, computation, decisions, and actuation form one integrated loop. Hardware factors such as timing, energy efficiency, reliability, and thermal limits directly shape what an AI system can achieve. System requirements should be derived from the physical task and operating environment, with models and computing platforms chosen together to avoid impractical or overly constrained designs. Sensors define what the AI can observe, while actuators define the physical actions it can take, making their characteristics central to architecture. The chapter emphasizes that increasing capability brings unavoidable tradeoffs among performance, power, cost, weight, and bandwidth.

0
ProgrammingDEV Community ·

Physical AI Co-Design: Why Robot Hardware and AI Must Be Engineered Together

The chapter argues that intelligent robots cannot be designed well by treating the physical platform, software, and AI model as separate parts, since their capabilities are tightly linked to the body and environment. It holds that system performance comes from integration rather than optimizing any single component alone. The first principle is that the mission, task, and operating environment should shape the architecture, with requirements for latency, robustness, power, and size derived from what the system must accomplish. The text also treats the robot's physical embodiment as a central design variable, since geometry, mass, actuators, and sensors determine what the AI can perceive and how it can act. Finally, it stresses selecting AI models and hardware together, because more capable models demand more compute, memory, and power, and hardware-aware model design is needed for real-world deployment.