article thumbnail

Database Refactoring Patterns with Pramod Sadalage - Episode 22

Data Engineering Podcast

Links Database Refactoring Website Book Thoughtworks Martin Fowler Agile Software Development XP (Extreme Programming) Continuous Integration The Book Wikipedia Test First Development DDL (Data Definition Language) DML (Data Modification Language) DevOps Flyway Liquibase DBMaintain Hibernate SQLAlchemy ORM (Object Relational Mapper) ODM (Object Document (..)

Database 100
article thumbnail

Unpacking Fauna: A Global Scale Cloud Native Database

Data Engineering Podcast

It is definitely worth a good look for anyone building a platform that needs a simple to manage data layer that will scale with your business. It is definitely worth a good look for anyone building a platform that needs a simple to manage data layer that will scale with your business.

Database 100
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Using FoundationDB As The Bedrock For Your Distributed Systems

Data Engineering Podcast

If you need a foundation for your distributed systems, then FoundationDB is definitely worth a closer look. If you need a foundation for your distributed systems, then FoundationDB is definitely worth a closer look. Can you explain what FoundationDB is and how you got involved with the project?

Systems 100
article thumbnail

From Big Data to Better Data: Ensuring Data Quality with Verity

Lyft Engineering

Data quality is an amorphous term, with various definitions depending on the context. In Verity, we defined data quality as follows: Verity’s Definition of Data Quality The measure of how well data can be used as intended. Five aspects of data quality with the definition in italics and an example in quotes.

article thumbnail

Is Aws Certification Worth It?

Knowledge Hut

There is a definite reason for that. So, presently, AWS certification is definitely worth it! You might have a lot going on right now, but it is definitely worth to make some compromise for AWS certifications. AWS certification helps you reach new heights in your career with improved pay and job opportunities.

AWS 98
article thumbnail

Most important Data Engineering Concepts and Tools for Data Scientists

DareData

This can definitely be a complex process, as it often involves dealing with large volumes of data, handling errors and exceptions. Learning SQL / NoSQL and how major orchestrators work will definitely narrow the gap between the quality model training and model deployment. Examples of NoSQL databases include MongoDB or Cassandra.

article thumbnail

Using CockroachDB to Reduce Feature Store Costs by 75%

DoorDash Engineering

Condensing our writes using JSON Maps Our prior tests showed significant improvements in performance when using a NoSQL approach, where values for an entity are stored in a JSON map, but had some concerns with this approach since the documentation on CockroachDB indicates that performance may start to degrade once the JSON map is >1MB in size.