KDnuggets

AUGUST 20, 2024

Learn how to build the recommendation system with advanced technology.

Systems 123

Systems Building Technology Machine Learning 123

databricks

AUGUST 20, 2024

Special thanks to Kevin Glover, Martin Ko, Kuber Sharma and the team at Tableau for their valuable insights and contributions to this blog.

116

116

KDnuggets

AUGUST 20, 2024

This article explains the basics of time series analysis. Learn to prepare your data and visualize trends in R.

Data 118

Data Programming 118

Confessions of a Data Guy

AUGUST 20, 2024

Recently, for some unknown reason, I was pursuing the new Stackoverflow … called Reddit, for Data Engineering … and I ran across an interesting question … more or less it was related to “what makes a good Software Engineer … in a Data Engineering context.” This isn’t the first time this idea has come up […] The post What is a “Good” Data or Software Engineer?

Software Engineer 114

Software Engineer Software Engineering Engineering Data Engineering 114

Advertisement

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

Datasets

KDnuggets

AUGUST 20, 2024

Looking to make your data visuals stand out? Check out these five tips for effective data visualization.

Data 115

Data Data Science 115

Cloudera

AUGUST 20, 2024

By now, every organization, regardless of industry, has at least explored the use of AI, if not already embraced it. In today’s market, the AI imperative is firmly here, and failing to act quickly could mean getting left behind. But even as adoption soars, struggles remain, and scalability continues to be a major issue. Organizations are quick to adopt AI, but getting it established across the organization brings a unique set of challenges that come into play.

Government 82

Government Data Lake Data Governance Data Architecture 82

Snowflake

AUGUST 20, 2024

Healthcare and life sciences professionals face unique challenges when they want to use customer data. Much of this data is sensitive and highly regulated by laws like HIPAA. Data also tends to be fragmented between disparate systems, serving different stakeholders, such as patients, providers, business teams, insurance companies and more. These challenges are worth grappling with.

Healthcare 52

Healthcare Hospitality Electronics Government 52

Cloudyard

AUGUST 20, 2024

Read Time: 1 Minute, 13 Second Imagine a scenario where a business needs to automatically generate and send customer invoices at the end of each month. The invoices are generated from transaction data store in Snowflake, and customer receives an email with invoice attach as a CSV file. This use case requires a solution that can not only generate the invoices but handle email distribution with attachments.

Utilities 52

Utilities Coding Accessible Accessibility 52

Hevo

AUGUST 20, 2024

When it comes to orchestrating workflows and managing data pipelines, Luigi and Airflow are two of the most popular tools in the industry. Both have their own unique strengths and use cases, but choosing between them can be challenging.

Data Pipeline 52

Data Pipeline Management IT Data 52

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

databricks

AUGUST 20, 2024

An MBA intern’s summer experience: curating a custom Databricks AI/BI Genie Space to answer critical data questions and speed up enterprise workflows by 10X.

BI 52

BI Data 52

Hevo

AUGUST 20, 2024

Data has become the foundation of any successful business. The ability to efficiently extract, transform, and load data for analysis is crucial for making informed data-driven decisions. Therefore, the tools you choose for managing your business data are also extremely important. This blog will discuss two such tools: dbt and Airflow.

Management 52

Management Data Data Engineering Data Engineer 52

DataKitchen

AUGUST 20, 2024

DataOps, the promising future that nobody seems to be able to make reality. But not for lack of trying: meet Chris Bergh, "Head Chef" at DataKitchen, joining us again to tell us how te filed evolved over the last few years. To get in.

52

52

Striim

AUGUST 20, 2024

In today’s fast-paced retail environment, digital transformation is essential to stay competitive. One powerful way to achieve this transformation is by modernizing data architecture and migrating to the cloud. There are countless ways to leverage Striim but this is one of the most exciting, as the platform offers large retailers the tools they need to seamlessly transition from legacy systems to a more agile, cloud-based infrastructure.

Retail 52

Retail Cloud Google Cloud Data Architecture 52

Advertisement

With over 30 million monthly downloads, Apache Airflow is the tool of choice for programmatically authoring, scheduling, and monitoring data pipelines. Airflow enables you to define workflows as Python code, allowing for dynamic and scalable pipelines suitable to any use case from ETL/ELT to running ML/AI operations in production. This introductory tutorial provides a crash course for writing and deploying your first Airflow pipeline.

Cloud

DareData

AUGUST 20, 2024

Learn how AI Agents can transform your customer support processes In today’s world, the way businesses interact with customers is evolving rapidly. AI agents, powered by advanced technologies like large language models (LLMs) and natural language processing (NLP), are revolutionizing customer support. In the past, deploying chatbots often led to customer dissatisfaction.

Technology 52

Technology Project Database Machine Learning 52

Scott Logic

AUGUST 20, 2024

To begin with a quote regularly and erroneously attributed to Henry Ford , “If I had asked my customers what they wanted, they would have said a faster horse.” A lot of the hype surrounding the latest developments in Generative AI (GenAI) focuses on its potential to carry out particular tasks much faster than humans. It’s an understandable human impulse to look for ways to speed up time-consuming (boring?

Government 52

Government Consulting Medical Data Science 52

Hevo

AUGUST 20, 2024

Ensuring the quality and reliability of data is crucial in today’s data-driven world, as it is essential for making informed decisions and improving operational efficiency. This is where data observability comes into play. It is understanding, diagnosing, and managing data health throughout the lifecycle.

SQL 40

SQL Data Cloud Management 40

Edureka

AUGUST 20, 2024

You might be willing to become a future planning manager and be a part of the successful days of your business. Prince2 Project planning offers people like you the skills and knowledge needed. This will help you to plan, execute, and implement projects properly and efficiently. Different topics like project start-up, scope definition, budgeting, scheduling, risk management, and stakeholder communication are covered in the courses.

Project 40

Project Utilities Management Designing 40

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Pinterest Engineering

AUGUST 20, 2024

Ning Zhang; Sr. Technical Program Manager | Ang Xu; Principal Machine Learning Engineer | Claire Liu; Staff Software Engineer | Haichen Liu; Staff Software Engineer | Yiran Zhao; Staff Software Engineer | Haoyu He; Sr. Software Engineer | Sergei Radutnuy; Sr. Machine Learning Engineer | Di An; Sr. Software Engineer | Danyal Raza; Sr. Software Engineer | Xuan Chen; Sr.

Systems 62

Systems Software Engineer Software Engineering Java 62

Edureka

AUGUST 20, 2024

We shall explore several Prince2 techniques during this post. These methodical techniques help teams effectively begin, organize, complete, oversee, and conclude Prince2s. Scrum, Waterfall, and Agile techniques are a couple of examples. To ensure the success of Prince2 Certification, each Prince2 management methodology offers unique roles, procedures, and deliverables.

Project 40

Project Management Certification Healthcare 40

Edureka

AUGUST 20, 2024

In this article, we will briefly examine AWS’s well-architected framework, try to understand its six principles, and explain why they are essential. We aim to offer you all a simplistic guideline with comprehensible and concise information. Table of Content What is AWS Well-Architected Framework? The 6 Pillars of the AWS Well-Architected Framework Operational Excellence Security Reliability Performance Efficiency Cost Optimization Sustainability Why the AWS Well-Architected Framework is Im

AWS 40

AWS Amazon Web Services Cloud Cloud Computing 40

Edureka

AUGUST 20, 2024

Prince2 is intended to supply a thorough understanding of risk identification, assessment, and mitigation during a certain sector. Techniques for risk analysis, risk assessment frameworks, and risk communication methods are a number of the themes covered in these courses. To enhance their risk management abilities, students also study business continuity planning, crisis management, and regulatory compliance.

Process 40

Process Management Certification Project 40

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture