Towards Data Science

JANUARY 20, 2024

Automate resource provisioning with modern tools Continue reading on Towards Data Science »

Data Engineering 98

Data Engineering Data Engineer Engineering Data Science 98

KDnuggets

JANUARY 23, 2024

Prompt engineering and generative AI are becoming hotter by the day. Be part of the heat!

Engineering 159

Engineering 159

Data Engineering Podcast

JANUARY 21, 2024

Summary Databases and analytics architectures have gone through several generational shifts. A substantial amount of the data that is being managed in these systems is related to customers and their interactions with an organization. In this episode Tasso Argyros, CEO of ActionIQ, gives a summary of the major epochs in database technologies and how he is applying the capabilities of cloud data warehouses to the challenge of building more comprehensive experiences for end-users through a modern c

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

ArcGIS

JANUARY 22, 2024

Equivalency enhancements to geoprocessing in ArcGIS Pro 3.2 to remove more barriers for those transitioning from ArcMap.

139

139

Advertisement

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

Datasets

databricks

JANUARY 24, 2024

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have.

Certification 138

Certification Engineering Data 138

Snowflake

JANUARY 23, 2024

Many developers and enterprises looking to use machine learning (ML) to generate insights from data get bogged down by operational complexity. We have been making it easier and faster to build and manage ML models with Snowpark ML , the Python library and underlying infrastructure for end-to-end ML workflows in Snowflake. With Snowpark ML, data scientists and ML engineers can use familiar Python frameworks for preprocessing and feature engineering as well as training models that can be managed a

Machine Learning 133

Machine Learning Metadata Python Telecommunication 133

Christophe Blefari

JANUARY 26, 2024

Hey ( credits ) Hey, new week new email. This is already end of January but I took time to travel and see people I did not see for a long time so I'm super happy how this new year is starting. Next week, I'll be wrapping up my DataOps lecture by incorporating how to deploy machine learning models. This is a fun part where students learn how to serve a simple classifier in production.

Algorithm 130

Algorithm Google Cloud Data Java 130

Waitingforcode

JANUARY 23, 2024

Data enrichment is one of common data engineering tasks. It's relatively easy to implement with static datasets because of the data availability. However, this apparently easy task can become a nightmare if used with inappropriate technologies.

Datasets 130

Datasets Data Engineering Data Engineer Technology 130

KDnuggets

JANUARY 23, 2024

Here are data repositories that will up your data science game and improve your data projects.

Data Science 152

Data Science Project Data Machine Learning 152

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

databricks

JANUARY 22, 2024

Generative AI has opened new worlds of possibilities for businesses and is being emphatically embraced across organizations. According to a recent MIT Tech.

Building 128

Building 128

Christophe Blefari

JANUARY 20, 2024

Learn data engineering, all the references ( credits ) This is a special edition of the Data News. But right now I'm in holidays finishing a hiking week in Corsica 🥾 So I wrote this special edition about: how to learn data engineering in 2024. The aim of this post is to create a repository of important links and concepts we should care about when we do data engineering.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Confessions of a Data Guy

JANUARY 26, 2024

Well, I hate to break the news to you. I was the same when I first started, writing code that is. I was a zealot. I was zealous for every new thing I learned, every new language, every new approach, I would find the preacher who was preaching the message I wanted to hear … […] The post The Difficulties of Senior Engineer … are not Engineering appeared first on Confessions of a Data Guy.

Engineering 114

Engineering Coding Data Data Engineering 114

KDnuggets

JANUARY 25, 2024

Improve your version control skills to resolve issues and maintain a clean Git repository.

Programming 147

Programming 147

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

databricks

JANUARY 24, 2024

Reliable, accurate and trusted data is the most critical requirement for any data application in an enterprise. As Databricks customers increasingly rely on.

Data 119

Data 119

ThoughtSpot

JANUARY 23, 2024

ThoughtSpot is taking Snowpark use cases to the next level with generative AI, connecting the dots between ML-powered insights and business action. If you’re new to Snowpark, this is Snowflake ’s set of libraries and runtimes that securely deploy and process non-SQL code including Python, Java, and Scala. Combining the power of Snowflake Snowpark and ThoughtSpot, developers and data professionals can create models, uncover insights, and build data apps using their preferred programming language.

Scala 113

Scala Programming Language Java Python 113

Snowflake

JANUARY 25, 2024

This year may be the most innovative on record. Recent advances in AI are beginning to transform how we live and work. And the potential impacts of artificial intelligence (AI) on the healthcare and life sciences industries are expected to be far-reaching. It’s essential for organizations to leverage vast amounts of structured and unstructured data for effective generative AI (gen AI) solutions that deliver a clear return on investment.

Healthcare 105

Healthcare Hospitality Electronics Medical 105

KDnuggets

JANUARY 23, 2024

Want to make a successful career switch to data science? From learning data science concepts to cracking interviews, read this guide to move one step closer to your first data science job.

Data Science 145

Data Science Data 145

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

databricks

JANUARY 23, 2024

This post is part of a series. Check out Part 1: The Data + AI Trifecta: People, Process, and Platform In the current.

Data 108

Data Process 108

Knowledge Hut

JANUARY 25, 2024

With over a decade of my experience in Project management, I might have crashed about 80% of my Project. Project Crashing is not a negative or a bad thing like it sounds, instead it serves as a strategy in project management, aimed at expediting project timelines without compromising the project's scope. It's very different from fast-tracking, which involves resequencing activities, and scope changes, which alter project objectives, project crashing focuses on deploying additional resour

Project 98

Project Management Process Certification 98

Snowflake

JANUARY 26, 2024

A key benefit of the Snowflake Data Cloud is the elimination of data silos. Fundamental to this outcome is the ability of customers to operate and collaborate globally. To support this, the Data Cloud was designed to provide customers with the same product experience—including security and governance capabilities — across multiple cloud regions with the three major cloud providers: AWS, Azure, and Google Cloud.

Google Cloud 100

Google Cloud AWS Cloud Government 100

KDnuggets

JANUARY 23, 2024

Learn what Predictive GenAI does and how it can make predictive analytics far more accessible, efficient, and meaningful for your business.

Accessible 141

Accessible Accessibility IT 141

Advertisement

With over 30 million monthly downloads, Apache Airflow is the tool of choice for programmatically authoring, scheduling, and monitoring data pipelines. Airflow enables you to define workflows as Python code, allowing for dynamic and scalable pipelines suitable to any use case from ETL/ELT to running ML/AI operations in production. This introductory tutorial provides a crash course for writing and deploying your first Airflow pipeline.

Cloud

Towards Data Science

JANUARY 26, 2024

The way you retrieve variables from Airflow can impact the performance of your DAGs Continue reading on Towards Data Science »

Data Science 98

Data Science Data Machine Learning Programming 98

Knowledge Hut

JANUARY 24, 2024

Step into the realm of data visualization with a comprehensive exploration of Power BI and Tableau. In a world where data is important, deciding between power bi vs tableau can change your path in analyzing things. As we explore the pasts and ways that Power BI and Tableau work, it'll help us understand what makes these tools special. If you are an expert in working with data or a beginner excited to use visualization, this blog will help you understand the differences between power bi and t

BI 98

BI Business Intelligence Non-relational Database Machine Learning 98

Pinterest Engineering

JANUARY 26, 2024

Jeremy Krach | Staff Security Engineer, Platform Security Background Several years ago, Pinterest had a short incident due to oversights in the policy delivery engine. This engine is the technology that ensures a policy document written by a developer and checked into source control is fully delivered to the production system evaluating that policy, similar to OPAL.

Engineering 96

Engineering Architecture Systems Metadata 96

KDnuggets

JANUARY 24, 2024

Transform your AI aspirations into reality—join Uplimit's AI revolution!

Building 135

Building 135

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

databricks

JANUARY 24, 2024

We're excited to announce the winners of Databricks' inaugural Asia-Pacific Large Language Model (LLM) Cup, a first-of-its-kind competition in the region, which garnered.

IT 94

IT 94

Knowledge Hut

JANUARY 22, 2024

In today's era of digital transformation and rapidly evolving technological trends, it is imperative for IT professionals to keep up with the latest know-how about the subject matter, tools, and skills. Other than pursuing career-oriented courses and certifications, there is no better way for professionals to achieve this objective. Certifications are like stepping stones for professionals guiding their career journey and learning paths to progress ahead and stay in vogue with job demands as wel

Certification 98

Certification Project Building Education 98

Zalando Engineering

JANUARY 22, 2024

The perfect storm In the mids of Cyber Week preparation in November 2022, I was DMd by a colleague with a request to quickly join a call. To my surprise as I was anticipating a 1:1 call, I got greeted by a message indicating that 60+ others are in the call as well. It turned out that I was just about to join an incident response call for what later got to be known internally as the "metadpata" incident.

AWS 79

AWS Metadata Cloud Process 79