article thumbnail

Why Open Table Format Architecture is Essential for Modern Data Systems

phData: Data Engineering

The world we live in today presents larger datasets, more complex data, and diverse needs, all of which call for efficient, scalable data systems. These systems are built on open standards and offer immense analytical and transactional processing flexibility. These formats are transforming how organizations manage large datasets.

article thumbnail

Happy Leap Day!

The Pragmatic Engineer

But first, a few current cases of systems whose developers didn’t: In Sweden, card payments are down at a leading supermarket chain. Airline Avianca printed tickets dated as 3/1 instead of 2/29, thanks to their system not accounting for the leap day. The system was almost fully restored before noon.”

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

The Collapse of Silicon Valley Bank

The Pragmatic Engineer

The bank’s systems start to be overloaded to the point of customers not being able to log on and transfer. The FDIC is a government agency whose goal is to maintain stability and public confidence in the US financial system. In general, I’m optimistic about the system’s ability to contain the fallout from SVB.

Banking 233
article thumbnail

Klarna’s AI chatbot: how revolutionary is it, really?

The Pragmatic Engineer

When an “out of bounds” topic comes up, the chatbot hands over to a human agent: My first attempt to get the chatbot to talk about non-shopping related topics led to a swift handoff to a human agent Poking at the system prompt A system prompt is a way to provide context and instructions before passing on the user input.

IT 240
article thumbnail

Going from Developer to CEO: Chronosphere

The Pragmatic Engineer

Microsoft In 2009, not many US tech companies were hiring, as the sector was still recovering from the 2008 crash. I wrote code for drivers on Windows, and started to put a basic observability system in place. EC2 had no observability system back then: people would spin up EC2 instances but have no idea whether or not they worked.

article thumbnail

Data Council 2023

Christophe Blefari

Organisations are systems with inputs and outputs and a formula. Scaling Uber metrics systems (w/ Pinot) — uMetric migration from ES to Pinot. He coined the "data scientist" term back in 2008. The analytics goal is to model correctly business. Formulas have metrics, relationships and weights.

Data 130
article thumbnail

Setting The Stage For The Next Chapter Of The Cassandra Database

Data Engineering Podcast

Summary The Cassandra database is one of the first open source options for globally scalable storage systems. Since its introduction in 2008 it has been powering systems at every scale. Cassandra is primarily used as a system of record. Since its introduction in 2008 it has been powering systems at every scale.

Database 100