KDnuggets

AUGUST 20, 2024

Learn how to build the recommendation system with advanced technology.

Systems 133

Systems Building Technology Machine Learning 133

databricks

AUGUST 20, 2024

Special thanks to Kevin Glover, Martin Ko, Kuber Sharma and the team at Tableau for their valuable insights and contributions to this blog.

116

116

KDnuggets

AUGUST 20, 2024

Looking to make your data visuals stand out? Check out these five tips for effective data visualization.

Data 128

Data Data Science 128

Confessions of a Data Guy

AUGUST 20, 2024

Recently, for some unknown reason, I was pursuing the new Stackoverflow … called Reddit, for Data Engineering … and I ran across an interesting question … more or less it was related to “what makes a good Software Engineer … in a Data Engineering context.” This isn’t the first time this idea has come up […] The post What is a “Good” Data or Software Engineer?

Software Engineer 113

Software Engineer Software Engineering Engineering Data Engineer 113

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

KDnuggets

AUGUST 20, 2024

This article explains the basics of time series analysis. Learn to prepare your data and visualize trends in R.

Data 123

Data Programming 123

Engineering at Meta

AUGUST 20, 2024

Delivering new AI technologies at scale also means rethinking every layer of our infrastructure – from silicon and software systems and even our data center designs. For the second year in a row, Meta’s engineering and infrastructure teams returned for the AI Infra @ Scale conference, where they discussed the challenges of scaling up an infrastructure for AI as well as work being done on our large-scale GPU clusters , open hardware designs for next-generation data center hardware, and how Meta i

Engineering 99

Engineering Designing Technology Systems 99

Snowflake

AUGUST 20, 2024

Healthcare and life sciences professionals face unique challenges when they want to use customer data. Much of this data is sensitive and highly regulated by laws like HIPAA. Data also tends to be fragmented between disparate systems, serving different stakeholders, such as patients, providers, business teams, insurance companies and more. These challenges are worth grappling with.

Healthcare 52

Healthcare Hospitality Electronics Government 52

Cloudyard

AUGUST 20, 2024

Read Time: 1 Minute, 13 Second Imagine a scenario where a business needs to automatically generate and send customer invoices at the end of each month. The invoices are generated from transaction data store in Snowflake, and customer receives an email with invoice attach as a CSV file. This use case requires a solution that can not only generate the invoices but handle email distribution with attachments.

Utilities 52

Utilities Coding Accessible Accessibility 52

Hevo

AUGUST 20, 2024

When it comes to orchestrating workflows and managing data pipelines, Luigi and Airflow are two of the most popular tools in the industry. Both have their own unique strengths and use cases, but choosing between them can be challenging.

Data Pipeline 52

Data Pipeline Management IT Data 52

databricks

AUGUST 20, 2024

An MBA intern’s summer experience: curating a custom Databricks AI/BI Genie Space to answer critical data questions and speed up enterprise workflows by 10X.

BI 52

BI Data 52

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

Hevo

AUGUST 20, 2024

Data has become the foundation of any successful business. The ability to efficiently extract, transform, and load data for analysis is crucial for making informed data-driven decisions. Therefore, the tools you choose for managing your business data are also extremely important. This blog will discuss two such tools: dbt and Airflow.

Management 52

Management Data Data Engineer Data Engineering 52

DataKitchen

AUGUST 20, 2024

DataOps, the promising future that nobody seems to be able to make reality. But not for lack of trying: meet Chris Bergh, "Head Chef" at DataKitchen, joining us again to tell us how te filed evolved over the last few years. To get in.

52

52

Striim

AUGUST 20, 2024

In today’s fast-paced retail environment, digital transformation is essential to stay competitive. One powerful way to achieve this transformation is by modernizing data architecture and migrating to the cloud. There are countless ways to leverage Striim but this is one of the most exciting, as the platform offers large retailers the tools they need to seamlessly transition from legacy systems to a more agile, cloud-based infrastructure.

Retail 52

Retail Cloud Google Cloud Data Architecture 52

DareData

AUGUST 20, 2024

Learn how AI Agents can transform your customer support processes In today’s world, the way businesses interact with customers is evolving rapidly. AI agents, powered by advanced technologies like large language models (LLMs) and natural language processing (NLP), are revolutionizing customer support. In the past, deploying chatbots often led to customer dissatisfaction.

Technology 52

Technology Project Database Machine Learning 52

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

Hevo

AUGUST 20, 2024

Ensuring the quality and reliability of data is crucial in today’s data-driven world, as it is essential for making informed decisions and improving operational efficiency. This is where data observability comes into play. It is understanding, diagnosing, and managing data health throughout the lifecycle.

SQL 40

SQL Data Cloud Management 40

Edureka

AUGUST 20, 2024

You might be willing to become a future planning manager and be a part of the successful days of your business. Prince2 Project planning offers people like you the skills and knowledge needed. This will help you to plan, execute, and implement projects properly and efficiently. Different topics like project start-up, scope definition, budgeting, scheduling, risk management, and stakeholder communication are covered in the courses.

Project 40

Project Utilities Designing Management 40

Pinterest Engineering

AUGUST 20, 2024

Ning Zhang; Sr. Technical Program Manager | Ang Xu; Principal Machine Learning Engineer | Claire Liu; Staff Software Engineer | Haichen Liu; Staff Software Engineer | Yiran Zhao; Staff Software Engineer | Haoyu He; Sr. Software Engineer | Sergei Radutnuy; Sr. Machine Learning Engineer | Di An; Sr. Software Engineer | Danyal Raza; Sr. Software Engineer | Xuan Chen; Sr.

Systems 65

Systems Software Engineer Software Engineering Java 65

Edureka

AUGUST 20, 2024

We shall explore several Prince2 techniques during this post. These methodical techniques help teams effectively begin, organize, complete, oversee, and conclude Prince2s. Scrum, Waterfall, and Agile techniques are a couple of examples. To ensure the success of Prince2 Certification, each Prince2 management methodology offers unique roles, procedures, and deliverables.

Project 40

Project Management Certification Healthcare 40

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

Scott Logic

AUGUST 20, 2024

To begin with a quote regularly and erroneously attributed to Henry Ford , “If I had asked my customers what they wanted, they would have said a faster horse.” A lot of the hype surrounding the latest developments in Generative AI (GenAI) focuses on its potential to carry out particular tasks much faster than humans. It’s an understandable human impulse to look for ways to speed up time-consuming (boring?

Government 52

Government Consulting Medical Data Science 52

Edureka

AUGUST 20, 2024

In this article, we will briefly examine AWS’s well-architected framework, try to understand its six principles, and explain why they are essential. We aim to offer you all a simplistic guideline with comprehensible and concise information. Table of Content What is AWS Well-Architected Framework? The 6 Pillars of the AWS Well-Architected Framework Operational Excellence Security Reliability Performance Efficiency Cost Optimization Sustainability Why the AWS Well-Architected Framework is Im

AWS 40

AWS Amazon Web Services Cloud Cloud Computing 40

Edureka

AUGUST 20, 2024

Prince2 is intended to supply a thorough understanding of risk identification, assessment, and mitigation during a certain sector. Techniques for risk analysis, risk assessment frameworks, and risk communication methods are a number of the themes covered in these courses. To enhance their risk management abilities, students also study business continuity planning, crisis management, and regulatory compliance.

Process 40

Process Management Certification Project 40