KDnuggets

MARCH 15, 2022

This article discusses and demonstrates how to quickly engineer some common date features using Python.

Python 160

Python Engineering 160

Start Data Engineering

MARCH 18, 2022

Objective Setup Pre-requisites Components Source systems Schedule & Orchestrate Extract Load Transform Data visualization Choosing tools & frameworks Future work & improvements Conclusion Further reading References Objective It can be difficult to know where to begin when starting a data engineering side project. If you have wondered What data to use for your data project?

Data Engineer 147

Data Engineer Data Engineering Project Engineering 147

Confluent

MARCH 15, 2022

We are excited to announce ksqlDB 0.24! It comes with a slew of improvements and new features. Access to Apache Kafka® record headers will enable a whole host of new […].

Kafka 111

Kafka Accessibility Accessible IT 111

Data Engineering Podcast

MARCH 13, 2022

Summary Data observability is a term that has been co-opted by numerous vendors with varying ideas of what it should mean. At Acceldata, they view it as a holistic approach to understanding the computational and logical elements that power your analytical capabilities. In this episode Tristan Spaulding, head of product at Acceldata, explains the multi-dimensional nature of gaining visibility into your running data platform and how they have architected their platform to assist in that endeavor.

Data Lake 100

Data Lake Relational Database Data Engineer Data Engineering 100

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

KDnuggets

MARCH 14, 2022

In this article, we will be going through the algorithms that can be used for classification tasks.

Algorithm 160

Algorithm Machine Learning 160

Teradata

MARCH 16, 2022

Neither crystal balls nor black boxes will provide the agility needed for accurate demand forecasting in today’s retail & CPG environment. Learn more about new approaches to FDP.

Retail 98

Retail 98

Data Engineering Podcast

MARCH 13, 2022

Summary The modern data stack is a constantly moving target which makes it difficult to adopt without prior experience. In order to accelerate the time to deliver useful insights at organizations of all sizes that are looking to take advantage of these new and evolving architectures Tarush Aggarwal founded 5X Data. In this episode he explains how he works with these companies to deploy the technology stack and pairs them with an experienced engineer who assists with the implementation and traini

Data 100

Data Metadata Software Engineer Software Engineering 100

KDnuggets

MARCH 15, 2022

Also: Decision Tree Algorithm, Explained; The Complete Collection of Data Science Cheat Sheets – Part 2; Top Programming Languages and Their Uses; The Complete Collection of Data Science Cheat Sheets – Part 1.

Machine Learning 158

Machine Learning Programming Language Building Data Science 158

Confluent

MARCH 16, 2022

Gemma Singleton joined Confluent three years ago as an associate level solutions architect. While the job at Confluent appeared less “senior” than the position she was leaving, moving into a […].

Building 72

Building Management 72

Cloudera

MARCH 17, 2022

Data is the true currency of the digital age, and it plays an indispensable role in defining and accelerating the mission of Government agencies. . Every level of government is awash in data (both structured and unstructured) that is perpetually in motion. It is constantly generated – and always growing in volume – by an ever-growing range of sources, from IoT sensors and other connected devices at the edge to web and social media to video and more.

Transportation 90

Transportation Government Consulting Machine Learning 90

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

AltexSoft

MARCH 18, 2022

As it sometimes happens, when one approach doesn’t work to solve a particular problem, you try a different one. When that approach doesn’t work either, it may be a good idea to combine the best parts of both. At least that’s often the case with technology tasks. Machine learning is no exception. You’ve probably heard of two main ML techniques — supervised and unsupervised learning.

Datasets 52

Datasets Machine Learning Algorithm Raw Data 52

KDnuggets

MARCH 16, 2022

The best knowledge is still placed in the libraries; within books. In this article, discover some of the top recommended Data Science books catering to beginners.

Data Science 154

Data Science Data 154

Rockset

MARCH 17, 2022

If you’re thinking about implementing real-time analytics , you've probably realized that you're going to need real-time updates. Real-time updates give you the power to insert, delete and update data in place. To do that, you'll need something more: a mutable database. In this post we'll discuss the three main reasons why a mutable database is required for real-time updates. 1) Late Arriving Data in Time-Based Window Rollups ⌛️ Let's say you have a rollup that's counting events for each hour.

Database 52

Database IT PostgreSQL MongoDB 52

Cloudera

MARCH 15, 2022

Each year, various departments and teams across the organization welcome early talent to embark on internships which allow them to kickstart their careers within the technology and big data industries. One of those early talent interns is Trang Luong, who worked within the APAC Inside Sales team earlier this year for a six-months, supporting the team in connecting with prospects and customers to guide them in their data-driven journey. .

Recruitment 86

Recruitment Big Data Engineering Technology 86

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Palantir

MARCH 16, 2022

Engineering for Impact: Problem solving with purpose at Palantir Editor’s note: In this blog post, we sit down with UK Health Lead Joanna Peller, recipient of Data IQ’s 2022 100 award, to discuss what she’s learned leading Palantir’s UK Health work during the pandemic. Describe your path to Palantir. After growing up in Boston, Massachusetts, I moved to the UK to study Mathematics at UCL.

Engineering 52

Engineering Healthcare Manufacturing Consulting 52

KDnuggets

MARCH 18, 2022

Real-time AI/ML is on the rise and feature stores are key to successfully deploying them. Read on to see how the choice of online store and the feature store architecture play important roles in determining its performance and cost.

Machine Learning 150

Machine Learning Architecture IT Data Science 150

Rockset

MARCH 15, 2022

Growth of the Internet of Things (IoT) hasn’t matched the hype due to numerous pain points: limited, unreliable network coverage, high connectivity, and device maintenance costs, and the uncertainty created by diverse, constantly-evolving cellular standards (4G versus 5G, LTE-M versus NB-IoT, etc.) 1NCE was founded in 2017 as a pure-play IoT connectivity provider to jumpstart IoT deployments by solving every one of those pain points.

NoSQL 52

NoSQL AWS SQL Database 52

Cloudera

MARCH 14, 2022

The world cannot ignore the horrific invasion of Ukraine and the plight of the Ukrainian people, who are facing death and devastation in the defense of their country. Our Cloudera team members and their families in Ukraine have been impacted in ways we cannot imagine, and their safety is our top priority. . Cloudera – and many of our employees individually – are engaged in multiple activities to help Ukrainians, including donating supplies, running a donation matching program, and providing acco

Transportation 10

Transportation Government Programming IT 10

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Monte Carlo

MARCH 14, 2022

The companies we talk to are diligently building their data product or platform. This includes migrating to Snowflake , integrating with Databricks, moving towards a data mesh , or generally investing in their data stack. Increasingly, we are seeing data departments modernize their team structure with data product managers at the helm of such projects.

Management 59

Management Software Engineer Software Engineering Data 59

KDnuggets

MARCH 17, 2022

Check out this article on using CTGANs to create synthetic datasets for reducing privacy risks, training and testing machine learning models, and developing data-centric AI products.

Datasets 149

Datasets Machine Learning Data Data Science 149

KDnuggets

MARCH 17, 2022

How will AI and data science impact the world of business in the next decade? Find out what trends to look out for in 2022 and beyond at NVIDIA GTC.

Data Science 149

Data Science Data 149

KDnuggets

MARCH 17, 2022

In this short blog, we’ll review the process of taking a POC data science pipeline (ML/Deep learning/NLP) that was conducted on Google Colab, and transforming it into a pipeline that can run parallel at scale and works with Git so the team can collaborate on.

Deep Learning 148

Deep Learning Data Science Process IT 148

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

MARCH 18, 2022

In this blog, you will see how to build a web-application with Greppo and Google Earth using Python.

Python 143

Python Building Engineering 143

KDnuggets

MARCH 15, 2022

Have you spent hours taking coding bootcamps, online courses, and tutorials, only to feel like you aren’t getting anywhere?

Programming 134

Programming Coding 134

KDnuggets

MARCH 16, 2022

In this guide, we'll learn how to use multiple inheritance in Python and make it sustainable.

Python 131

Python Management IT 131

KDnuggets

MARCH 17, 2022

Still running your artificial intelligence workloads in the cloud? If your applications depend on techniques like person detection and pose estimation to name a few, then it’s time you looked into on-device AI.

Cloud 122

Cloud 122

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

MARCH 16, 2022

Competition for viewers’ attention is not over after the players leave the field. Now, anyone who can put up a highlight compilation or a game summarization first gets the edge. So, let’s talk about how media companies do just that — with the help of Artificial Intelligence.

Media 116

Media 116

KDnuggets

MARCH 14, 2022

If your new year's resolution was to start a career in data science but you have stalled, simply follow these easy steps to acquire professional certification within a year.

Data Science 116

Data Science Certification Data 116

KDnuggets

MARCH 16, 2022

Deep dive into Kubernetes, the essential tool for anyone deploying and managing cloud-native applications!

Cloud 106

Cloud Management 106

KDnuggets

MARCH 18, 2022

Join this webinar and learn how competitive companies utilize third-party data, enhancing mobile customer experiences, through personalization and localization.

Utilities 102

Utilities Data 102

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud