Towards Data Science

JANUARY 20, 2024

Automate resource provisioning with modern tools Continue reading on Towards Data Science »

Data Engineer 76

Data Engineer Data Engineering Engineering Data Science 76

KDnuggets

JANUARY 23, 2024

Prompt engineering and generative AI are becoming hotter by the day. Be part of the heat!

Engineering 159

Engineering 159

Data Engineering Podcast

JANUARY 21, 2024

Summary Databases and analytics architectures have gone through several generational shifts. A substantial amount of the data that is being managed in these systems is related to customers and their interactions with an organization. In this episode Tasso Argyros, CEO of ActionIQ, gives a summary of the major epochs in database technologies and how he is applying the capabilities of cloud data warehouses to the challenge of building more comprehensive experiences for end-users through a modern c

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

ArcGIS

JANUARY 22, 2024

Equivalency enhancements to geoprocessing in ArcGIS Pro 3.2 to remove more barriers for those transitioning from ArcMap.

139

139

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

databricks

JANUARY 24, 2024

Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have.

Certification 138

Certification Engineering Data 138

KDnuggets

JANUARY 23, 2024

Here are data repositories that will up your data science game and improve your data projects.

Data Science 159

Data Science Project Data Machine Learning 159

Waitingforcode

JANUARY 23, 2024

Data enrichment is one of common data engineering tasks. It's relatively easy to implement with static datasets because of the data availability. However, this apparently easy task can become a nightmare if used with inappropriate technologies.

Datasets 130

Datasets Data Engineer Data Engineering Technology 130

databricks

JANUARY 22, 2024

Generative AI has opened new worlds of possibilities for businesses and is being emphatically embraced across organizations. According to a recent MIT Tech.

Building 128

Building 128

KDnuggets

JANUARY 26, 2024

Data Engineering ZoomCamp offers free access to reading materials, video tutorials, assignments, homeworks, projects, and workshops.

Data Engineer 156

Data Engineer Data Engineering Engineering Data 156

Christophe Blefari

JANUARY 20, 2024

Learn data engineering, all the references ( credits ) This is a special edition of the Data News. But right now I'm in holidays finishing a hiking week in Corsica 🥾 So I wrote this special edition about: how to learn data engineering in 2024. The aim of this post is to create a repository of important links and concepts we should care about when we do data engineering.

Data Engineer 130

Data Engineer Data Engineering Engineering Hadoop 130

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Snowflake

JANUARY 23, 2024

Many developers and enterprises looking to use machine learning (ML) to generate insights from data get bogged down by operational complexity. We have been making it easier and faster to build and manage ML models with Snowpark ML , the Python library and underlying infrastructure for end-to-end ML workflows in Snowflake. With Snowpark ML, data scientists and ML engineers can use familiar Python frameworks for preprocessing and feature engineering as well as training models that can be managed a

Machine Learning 123

Machine Learning Metadata Python Telecommunication 123

databricks

JANUARY 24, 2024

Reliable, accurate and trusted data is the most critical requirement for any data application in an enterprise. As Databricks customers increasingly rely on.

Data 119

Data 119

KDnuggets

JANUARY 23, 2024

Want to make a successful career switch to data science? From learning data science concepts to cracking interviews, read this guide to move one step closer to your first data science job.

Data Science 156

Data Science Data 156

Christophe Blefari

JANUARY 20, 2024

Walking in the street be like recently ( credits ) Hey I hope this new edition finds you well. We are deep in the winter, it's time for comfy Data News to read near the fire 🔥 This week, on Monday, I started my annual university lecture. It's been 9 years since I started teaching and this year something was different. The students were incredibly calm, obviously my course is a bit difficult at the beginning because it touches on concepts that they are not used to—cloud,

Data 130

Data Python Google Cloud Algorithm 130

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Confessions of a Data Guy

JANUARY 26, 2024

Well, I hate to break the news to you. I was the same when I first started, writing code that is. I was a zealot. I was zealous for every new thing I learned, every new language, every new approach, I would find the preacher who was preaching the message I wanted to hear … […] The post The Difficulties of Senior Engineer … are not Engineering appeared first on Confessions of a Data Guy.

Engineering 113

Engineering Coding Data Data Engineer 113

ThoughtSpot

JANUARY 23, 2024

ThoughtSpot is taking Snowpark use cases to the next level with generative AI, connecting the dots between ML-powered insights and business action. If you’re new to Snowpark, this is Snowflake ’s set of libraries and runtimes that securely deploy and process non-SQL code including Python, Java, and Scala. Combining the power of Snowflake Snowpark and ThoughtSpot, developers and data professionals can create models, uncover insights, and build data apps using their preferred programming language.

Scala 113

Scala Programming Language Java Python 113

KDnuggets

JANUARY 25, 2024

Improve your version control skills to resolve issues and maintain a clean Git repository.

Programming 152

Programming 152

databricks

JANUARY 23, 2024

This post is part of a series. Check out Part 1: The Data + AI Trifecta: People, Process, and Platform In the current.

Data 109

Data Process 109

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Knowledge Hut

JANUARY 25, 2024

With over a decade of my experience in Project management, I might have crashed about 80% of my Project. Project Crashing is not a negative or a bad thing like it sounds, instead it serves as a strategy in project management, aimed at expediting project timelines without compromising the project's scope. It's very different from fast-tracking, which involves resequencing activities, and scope changes, which alter project objectives, project crashing focuses on deploying additional resour

Project 98

Project Management Process Certification 98

Snowflake

JANUARY 25, 2024

This year may be the most innovative on record. Recent advances in AI are beginning to transform how we live and work. And the potential impacts of artificial intelligence (AI) on the healthcare and life sciences industries are expected to be far-reaching. It’s essential for organizations to leverage vast amounts of structured and unstructured data for effective generative AI (gen AI) solutions that deliver a clear return on investment.

Healthcare 94

Healthcare Hospitality Electronics Medical 94

KDnuggets

JANUARY 23, 2024

Learn what Predictive GenAI does and how it can make predictive analytics far more accessible, efficient, and meaningful for your business.

Accessibility 147

Accessibility Accessible IT 147

databricks

JANUARY 24, 2024

We're excited to announce the winners of Databricks' inaugural Asia-Pacific Large Language Model (LLM) Cup, a first-of-its-kind competition in the region, which garnered.

IT 95

IT 95

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Knowledge Hut

JANUARY 24, 2024

Step into the realm of data visualization with a comprehensive exploration of Power BI and Tableau. In a world where data is important, deciding between power bi vs tableau can change your path in analyzing things. As we explore the pasts and ways that Power BI and Tableau work, it'll help us understand what makes these tools special. If you are an expert in working with data or a beginner excited to use visualization, this blog will help you understand the differences between power bi and t

BI 98

BI Business Intelligence Non-relational Database Data Analysis 98

Pinterest Engineering

JANUARY 26, 2024

Jeremy Krach | Staff Security Engineer, Platform Security Background Several years ago, Pinterest had a short incident due to oversights in the policy delivery engine. This engine is the technology that ensures a policy document written by a developer and checked into source control is fully delivered to the production system evaluating that policy, similar to OPAL.

Engineering 93

Engineering Architecture Systems Metadata 93

KDnuggets

JANUARY 22, 2024

Context managers in Python help you handle resources efficiently. Let's learn how you can use them to manage database connections, subprocesses, and more.

Management 144

Management Python Database 144

Snowflake

JANUARY 26, 2024

A key benefit of the Snowflake Data Cloud is the elimination of data silos. Fundamental to this outcome is the ability of customers to operate and collaborate globally. To support this, the Data Cloud was designed to provide customers with the same product experience—including security and governance capabilities — across multiple cloud regions with the three major cloud providers: AWS, Azure, and Google Cloud.

Google Cloud 91

Google Cloud AWS Cloud Government 91

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Knowledge Hut

JANUARY 22, 2024

In today's era of digital transformation and rapidly evolving technological trends, it is imperative for IT professionals to keep up with the latest know-how about the subject matter, tools, and skills. Other than pursuing career-oriented courses and certifications, there is no better way for professionals to achieve this objective. Certifications are like stepping stones for professionals guiding their career journey and learning paths to progress ahead and stay in vogue with job demands as wel

Certification 98

Certification Project Building Education 98

Zalando Engineering

JANUARY 22, 2024

The perfect storm In the mids of Cyber Week preparation in November 2022, I was DMd by a colleague with a request to quickly join a call. To my surprise as I was anticipating a 1:1 call, I got greeted by a message indicating that 60+ others are in the call as well. It turned out that I was just about to join an incident response call for what later got to be known internally as the "metadpata" incident.

AWS 79

AWS Metadata Cloud Process 79

KDnuggets

JANUARY 24, 2024

Transform your AI aspirations into reality—join Uplimit's AI revolution!

Building 143

Building 143

Cloudera

JANUARY 26, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. This will allow a data office to implement access policies over metadata management assets like tags or classifications, business glossaries, and data catalog entities, laying the foundation for comprehensive data access control.

Metadata 79

Metadata Data Governance Government Management 79

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud