KDnuggets
DECEMBER 24, 2021
Feature selection methodologies go beyond filter, wrapper and embedded methods. In this article, I describe 3 alternative algorithms to select predictive features based on a feature importance score.
Data Engineering Podcast
DECEMBER 21, 2021
Summary One of the perennial challenges of data analytics is having a consistent set of definitions, along with a flexible and performant API endpoint for querying them. In this episode Artom Keydunov and Pavel Tiunov share their work on Cube.js and the various ways that it is being used in the open source community. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the p
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Cloudera
DECEMBER 21, 2021
Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. In working with thousands of customers deploying Spark applications, we saw significant challenges with managing Spark as well as automating, delivering, and optimizing secure data pipelines.
DataKitchen
DECEMBER 23, 2021
The post 2022 Big Data Predictions from the Cloud first appeared on DataKitchen.
Advertisement
In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate
KDnuggets
DECEMBER 23, 2021
Data Science models come with different flavors and techniques — luckily, most advanced models are based on a couple of fundamentals. Which models should you learn when you want to begin a career as Data Scientist? This post brings you 6 models that are widely used in the industry, either in standalone form or as a building block for other advanced techniques.
Data Engineering Podcast
DECEMBER 19, 2021
Summary Building a well managed data ecosystem for your organization requires a holistic view of all of the producers, consumers, and processors of information. The team at Metaphor are building a fully connected metadata layer to provide both technical and social intelligence about your data. In this episode Pardhu Gunnam and Mars Lan explain how they have designed the architecture and user experience to allow everyone to collaborate on the data lifecycle and provide opportunities for automatio
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
|
DataKitchen
DECEMBER 22, 2021
The post Reducing The Cost Of Failure With DataOps first appeared on DataKitchen.
KDnuggets
DECEMBER 23, 2021
Learn about the importance of environmental AI and its carbon impact in this comprehensive review.
Confluent
DECEMBER 21, 2021
Collecting and indexing logs from servers, applications, and devices enables crucial visibility into running systems. A log analytics pipeline allows teams to debug and troubleshoot issues, track historical trends, or […].
WeCloudData
DECEMBER 23, 2021
Objectives The following tutorial will demonstrate how to use a convenient tool from Canonical called Multipass to launch Ubuntu Linux virtual machines with ease Prerequisites Linux, MacOS or Windows Operating System Minimum 4 GB RAM (8 GB preferred) Introduction Linux is an essential building block in almost all IT ecosystems powering web servers, mobile phones […] The post Launch Linux Virtual Machines with Multipass appeared first on WeCloudData.
Speaker: Tamara Fingerlin, Developer Advocate
Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.
Elder Research
DECEMBER 22, 2021
The post How a Datathon Saved Christmas appeared first on Elder Research.
KDnuggets
DECEMBER 22, 2021
Start your learning journey in Reinforcement Learning with this first of two part tutorial that covers the foundations of the technique with examples and Python code.
ProjectPro
DECEMBER 21, 2021
Did you know that the global machine learning market, according to Fortune Business Insights, is expected to reach a whopping $152.24 billion in 2028? Machine learning, unlike other fields, has a global reach when it comes to job opportunities. The machine learning career path is perfect for you if you are curious about data, automation, and algorithms, as your days will be crammed with analyzing, implementing, and automating large amounts of knowledge.
WeCloudData
DECEMBER 23, 2021
Objectives The following tutorial will demonstrate how to use a convenient tool from Canonical called Multipass to launch Ubuntu Linux virtual machines with ease Prerequisites Linux, MacOS or Windows Operating System Minimum 4 GB RAM (8 GB preferred) Introduction Linux is an essential building block in almost all IT ecosystems powering web servers, mobile phones and IoT devices globally.
Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage
There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.
AltexSoft
DECEMBER 21, 2021
When people hear about artificial intelligence, deep learning, and machine learning , many think of movie-like robots that resemble or even outperform human intelligence. Others believe that such machines simply consume information and learn from it by themselves. Well… It’s kind of far from the truth. Computer systems have limited capabilities without human guidance, and data labeling is the way to teach them to become “smart.” In this article, you will find out what dat
KDnuggets
DECEMBER 21, 2021
Read on to learn more about the intricacies of federated learning and what it can do for machine learning on sensitive data.
Pipeline Data Engineering
DECEMBER 20, 2021
It's the time of the year when everybody is trying to summarise what happened in the last 12 months: 'best of' lists, highlights of the year and predictions for 2022 are dominating your inbox. This blog post is not different either. 2020 was definitely eventful , and 2021 came with its own set of surprises. But Pipeline Academy finally managed to get off the ground, we've launched three amazing cohorts and had loads of fun together with people from across the globe — literally.
WeCloudData
DECEMBER 23, 2021
Objectives The following tutorial will demonstrate how to use a convenient tool from Canonical called Multipass to launch Ubuntu Linux virtual machines with ease Prerequisites Linux, MacOS or Windows Operating System Minimum 4 GB RAM (8 GB preferred) Introduction Linux is an essential building block in almost all IT ecosystems powering web servers, mobile phones and IoT devices globally.
Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives
Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri
Emeritus
DECEMBER 20, 2021
Careers in data science have been generating quite the buzz lately and it’s not unfounded. Data science has evolved from being only analytics and statistics to decisions, predictions, and actions that move the world. Kira Radinsky of Diagnostic Robotics Chairwoman & CTO, shared, “My true passion is arming humanity with scientific capabilities to automatically anticipate,… The post Exploring Careers in Data Science One Byte at a Time appeared first on Emeritus Online Courses.
KDnuggets
DECEMBER 21, 2021
The all-knowing chatbots we once thought to be the future have been replaced by specialized bots, and the results are outstanding.
Grouparoo
DECEMBER 20, 2021
As Data Engineering keeps evolving, more traditional Software Engineering practices continue to be incorporated into the field. The development workflow for reverse ETL allows you to check configuration-as-code into a git repository, using the workflow you already know and love: create a pull request with your changes, have a team member review the code, and merge it in when it’s ready.
WeCloudData
DECEMBER 23, 2021
Objectives This tutorial will walk you through installing the user-friendly Linux sysadmin web console tool Cockpit Prerequisites Installed Linux OS (this tutorial uses the Debian-based Linux distro Ubuntu) Introduction Linux is extremely useful and powerful but due to its flexibility, extensibility, and versatility as an operating system with a plethora of utilities, it can be […] The post Install and Run Cockpit on Linux Virtual Machines appeared first on WeCloudData.
Advertisement
With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you
Preset
DECEMBER 20, 2021
After a decade of acquisitions in the BI space, Apache Superset remained one of the few open-source BI tools left with a semantic layer.
KDnuggets
DECEMBER 24, 2021
Check out these key development issues and tips learned from personal experience when deploying a TensorFlow-based image classifier Streamlit app on a Heroku server.
Teradata
DECEMBER 20, 2021
By using the analogy of a watchmaker to better understand data mesh, we see data products in the context of gears, with each gear serving a unique purpose. Read more.
WeCloudData
DECEMBER 23, 2021
Objectives This tutorial will walk you through installing the user-friendly Linux sysadmin web console tool Cockpit Prerequisites Installed Linux OS (this tutorial uses the Debian-based Linux distro Ubuntu) Introduction Linux is extremely useful and powerful but due to its flexibility, extensibility, and versatility as an operating system with a plethora of utilities, it can be overwhelming for beginners and even seasoned veterans.
Speaker: Tamara Fingerlin, Developer Advocate
In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!
Rock the JVM
DECEMBER 19, 2021
Demystify the tagless final pattern in Scala: it's not about type classes
KDnuggets
DECEMBER 20, 2021
XGBoost is an open-source implementation of gradient boosting designed for speed and performance. However, even XGBoost training can sometimes be slow. This article will review the advantages and disadvantages of each approach as well as go over how to get started.
ProjectPro
DECEMBER 22, 2021
John was a technology enthusiast who was eager to learn about and explore the benefits of machine learning. He enrolled in a few online machine learning bootcamps and learned the theory on how to use packages such as sci-kit-learn, Tensorflow , and Pytorch. Though John had a superficial understanding of the math involved in modifying parameters and constructing machine learning models , he could not apply them to a real-world business use case.
WeCloudData
DECEMBER 23, 2021
Objectives This tutorial will walk you through installing the user-friendly Linux sysadmin web console tool Cockpit Prerequisites Installed Linux OS (this tutorial uses the Debian-based Linux distro Ubuntu) Introduction Linux is extremely useful and powerful but due to its flexibility, extensibility, and versatility as an operating system with a plethora of utilities, it can be overwhelming for beginners and even seasoned veterans.
Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage
When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m
Expert insights. Personalized for you.
160 
Let's personalize your content