Seattle Data Guy

FEBRUARY 10, 2024

Photo by Tiger Lily Data warehouses and data lakes play a crucial role for many businesses. It gives businesses access to the data from all of their various systems. As well as often integrating data so that end-users can answer business critical questions. But if we take a step back and only focus on the… Read more The post Data Warehousing Essentials: A Guide To Data Warehousing appeared first on Seattle Data Guy.

Data Lake 162

Data Lake Data Warehouse Data Accessibility 162

KDnuggets

FEBRUARY 15, 2024

Simple explanations, no matter what your level is right now.

156

156

Data Engineering Podcast

FEBRUARY 11, 2024

Summary Sharing data is a simple concept, but complicated to implement well. There are numerous business rules and regulatory concerns that need to be applied. There are also numerous technical considerations to be made, particularly if the producer and consumer of the data aren't using the same platforms. In this episode Andrew Jefferson explains the complexities of building a robust system for data sharing, the techno-social considerations, and how the Bobsled platform that he is building

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

ArcGIS

FEBRUARY 16, 2024

We recently updated our online USGS historical topographic map collection with over 1,745 new maps for a new total of over 181,000 maps.

Accessibility 134

Accessibility Accessible Government 134

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Waitingforcode

FEBRUARY 13, 2024

It's time for another part of "What's new on the cloud for data engineers" Let's see what happened in the last 5 months.

Data Engineer 130

Data Engineer Data Engineering Cloud Engineering 130

KDnuggets

FEBRUARY 16, 2024

A Step-by-Step Approach to Unearthing Trends, Outliers, and Insights in your Data.

Data Analysis 153

Data Analysis Data Data Science 153

databricks

FEBRUARY 14, 2024

For the past two years, Databricks has collaborated with leading consulting partners to build innovative solutions for industry, migration, and data and AI.

Consulting 126

Consulting Building Data 126

ArcGIS

FEBRUARY 15, 2024

All we have to decide is what to map with the time that is given us.

122

122

KDnuggets

FEBRUARY 16, 2024

Whether you are a beginner or an experienced user, this guide is perfect for familiarizing yourself with basic and advanced command line tools.

Programming 153

Programming 153

Confluent

FEBRUARY 14, 2024

Confluent Platform 7.6 brings upgrading for existing clusters from ZooKeeper to KRaft, compaction support for Tiered Storage, OAuth (early access), improvements to the Oracle CDC premium connector, and more.

Accessibility 121

Accessibility Accessible 121

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Engineering at Meta

FEBRUARY 12, 2024

By now you’re already aware that Python 3.12 has been released. But did you know that several of its new features were developed by Meta ? Meta engineer Pascal Hartig ( @passy ) is joined on the Meta Tech Podcast by Itamar Oren and Carl Meyer, two software engineers at Meta, to discuss their teams’ contributions to the latest Python release, including new hooks that allow for custom JITs like Cinder , Immortal Objects , improvements to the type system, faster comprehensions, and more.

Python 111

Python Software Engineer Software Engineering Engineering 111

Snowflake

FEBRUARY 15, 2024

At Snowflake, we believe in empowering our customers to harness the full potential of their data while maintaining robust compliance standards and safeguarding data privacy. We recognize the critical importance of quickly identifying and safeguarding sensitive data objects, and we consistently strive to provide solutions that help achieve these goals — from advancements such as classification and tag-based policies to the intuitive Data Governance UI.

Data 105

Data Data Governance Government Data Analysis 105

KDnuggets

FEBRUARY 15, 2024

KDnuggets' latest original cheat sheet covers Jupyter Notebook magic methods. Check it out now and become a notebook magician.

IT 151

IT Machine Learning Programming Data Science 151

Netflix Tech

FEBRUARY 13, 2024

by Moshe Kolodny In this post, we’re excited to introduce SafeTest, a revolutionary library that offers a fresh perspective on End-To-End (E2E) tests for web-based User Interface (UI) applications. The Challenges of Traditional UI Testing Traditionally, UI tests have been conducted through either unit testing or integration testing (also referred to as End-To-End (E2E) testing).

Coding 102

Coding Utilities Architecture IT 102

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Knowledge Hut

FEBRUARY 16, 2024

An organization without strategic planning is like a ship without the captain. Developing strategic thinking into a plan and executing is inevitable for the businesses to compete in the global marketing environment. Strategic thinking, planning, and execution encompass all the concerns pertaining to ambitious goals, prevailing conditions, limitations, challenges, competence, changing customers’ preferences etc.

BI 98

BI Government Technology Project 98

databricks

FEBRUARY 14, 2024

In the dynamic realm of AI-driven forecasting, businesses navigate a landscape where strategic choices shape their trajectory. One such pivotal decision was made.

Retail 97

Retail 97

KDnuggets

FEBRUARY 13, 2024

Want to prepare your tech career for 2024 and onwards? Have a look at O’Reilly’s FREE technology trends report.

Technology 150

Technology 150

Cloudera

FEBRUARY 15, 2024

It’s hard to believe it’s been 15 years since the global financial crisis of 2007/2008. While this might be a blast from the past we’d rather leave in the proverbial rear-view mirror, in March of 2023 we were back to the future with the collapse of Silicon Valley Bank (SVB), the largest US bank to fail since 2008. While there are clear reasons SVB collapsed, which can be reviewed here , my purpose in this post isn’t to rehash the past but to present some of the regulatory and compliance c

Insurance 93

Insurance Banking Data Architecture Data Ingestion 93

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Knowledge Hut

FEBRUARY 16, 2024

Certified Business Analysis Professional ( CBAP ®) offered by the International Institute of Business Analysis (IIBA®) is the most prestigious professional certification that a business analyst can do. In order to tackle and conquer the exam you need meticulous planning, diligent and honest preparation and confidence in facing the exam. This article intends to provide guidance on passing the examination from the time of filling up the application form.

Certification 98

Certification Education Business Analyst BI 98

databricks

FEBRUARY 15, 2024

About UK Power Networks UK Power Networks is the largest electricity distributor in the UK. It maintains electricity cables and lines in London.

IT 96

IT 96

KDnuggets

FEBRUARY 14, 2024

If you’ve ever had conversations with data professionals, you’ve probably heard “data lineage” pop up quite a few times. So what is data lineage all about, and why is it important?

IT 150

IT Data Data Engineer Data Engineering 150

Snowflake

FEBRUARY 13, 2024

Snowflake kicked off 2024 with exciting releases, including Snowpark Model Registry, Streamlit in Snowflake for Azure, and new enhancements around security features in Snowflake Horizon. Read on to learn more about everything we announced in January. Snowpark Updates Model management with the Snowpark Model Registry – public preview Snowpark Model Registry is an integrated solution to register, manage and use models and their metadata natively in Snowflake.

Data Ingestion 92

Data Ingestion AWS Python Metadata 92

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Knowledge Hut

FEBRUARY 16, 2024

The conventional practices of working have changed in this 21st century. People cannot just stay as a specialist for a single area in the workplace anymore. These days, many people attend Agile Management certification courses online to learn the art of agility or how to become more adaptive at workplaces, which is a brilliant idea! They must have at least a preliminary knowledge of the job functions of other people in their company.

Recruitment 98

Recruitment Education Certification Systems 98

Towards Data Science

FEBRUARY 12, 2024

In this first article, we’re exploring Apache Beam, from a simple pipeline to a more complicated one, using GCP Dataflow.

Data Pipeline 91

Data Pipeline Data Process Process Data Science 91

KDnuggets

FEBRUARY 12, 2024

You don't always have high-quality labeled datasets for supervised machine learning. Learn about why you should augment your real data with synthetic data as well as the ways to generate it.

Machine Learning 147

Machine Learning Datasets Data IT 147

Snowflake

FEBRUARY 14, 2024

A strategic approach to data and talent strategies will distinguish leaders in a transformed business landscape. What might that look like? Generative AI’s (gen AI) capabilities seemed startlingly novel a year ago, when ChatGPT’s release led to an explosion of public usage and, simultaneously, intense debate about its potential societal and business impacts.

Architecture 89

Architecture Government Data Management Management 89

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Knowledge Hut

FEBRUARY 15, 2024

In today’s competitive world, the role of a business analyst has become one of the key elements for any business entity. In order to understand the role of a business analyst it is imperative to, first of all, understand what a business is and the complexities involved in operating a business entity. The definition of a business analyst as described in the BABOK® can be decoded as follows.

Business Analyst 98

Business Analyst Retail BI Business Intelligence 98

Towards Data Science

FEBRUARY 10, 2024

Advanced techniques to process and load data efficiently Continue reading on Towards Data Science »

Data Engineer 89

Data Engineer Data Engineering Engineering Data Science 89

KDnuggets

FEBRUARY 12, 2024

This blog will go through platforms and courses you can take that will get you from 0-100 on your data science knowledge.

Data Science 147

Data Science Data 147

DoorDash Engineering

FEBRUARY 13, 2024

Business Policy Experiments Using Fractional Factorial Designs At DoorDash, we constantly strive to improve our experimentation processes by addressing four key dimensions, including velocity to increase how many experiments we can conduct, toil to minimize our launch and analysis efforts, rigor to ensure a sound experimental design and robustly efficient analyses, and efficiency to reduce costs associated with our experimentation efforts.

Machine Learning 80

Machine Learning Designing Data Science Building 80

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud