Sat.Apr 23, 2022 - Fri.Apr 29, 2022

article thumbnail

Data Scientist, Data Engineer & Other Data Careers, Explained

KDnuggets

In this article, we will have a look at five distinct data careers, and hopefully provide some advice on how to get one's feet wet in this convoluted field.

article thumbnail

Introducing Current 2022: The Next Generation of Kafka Summit

Confluent

Data streaming is a new category of technology that is reshaping the way businesses operate, but there hasn’t been a place for everyone in the ecosystem to come together and […].

Kafka 106
article thumbnail

Data Is Now a Team Sport

Cloudera

This week I participated in an informative event that Cloudera hosted with TechCrunch: Data and the Culture Transformation. The event was moderated by tech industry analyst Maribel Lopez, and we were joined by Shirley Collie, chief health analytics actuary at Discovery Health in South Africa. The conversations focused on how company data cultures are rapidly evolving and delivering new levels of value to businesses with the emergence of data ecosystems.

Insurance 105
article thumbnail

Gain Visibility Into Your Entire Machine Learning System Using Data Logging With WhyLogs

Data Engineering Podcast

Summary There are very few tools which are equally useful for data engineers, data scientists, and machine learning engineers. WhyLogs is a powerful library for flexibly instrumenting all of your data systems to understand the entire lifecycle of your data from source to productionized model. In this episode Andy Dang explains why the project was created, how you can apply it to your existing data systems, and how it functions to provide detailed context for being able to gain insight into all o

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

15 Python Coding Interview Questions You Must Know For Data Science

KDnuggets

Solving the Python coding interview questions is the best way to get ready for an interview. That’s why we’ll lead you through 15 examples and five concepts these questions cover.

Coding 160
article thumbnail

Kafka Summit London 2022: The Full Recap

Confluent

It’s official: Kafka Summit is back! Technically, it never went away—it just went online. But this week in London, Kafka Summit returned in all its glory to welcome over 1,200 […].

Kafka 105

More Trending

article thumbnail

Operational Analytics At Speed With Minimal Busy Work Using Incorta

Data Engineering Podcast

Summary A huge amount of effort goes into modeling and shaping data to make it available for analytical purposes. This is often due to the need to simplify the final queries so that they are performant for visualization or limited exploration. In order to cut down the level of effort involved in making data usable, Matthew Halliday and his co-founders created Incorta as an end-to-end, in-memory analytical engine that removes barriers to insights on your data.

article thumbnail

Top 5 Free Cloud Notebooks in 2022

KDnuggets

Create and collaborate on data science projects or train machine learning models using free cloud Jupyter notebook platforms. You get a hassle-free IDE experience and free compute resources.

Cloud 158
article thumbnail

Big tech versus the airlines – who’s going to win in the modern retailing battle?

Teradata

Find out why data analytics and connectivity will be the difference between retailing taking off and being grounded.

Retail 98
article thumbnail

#ClouderaLife Spotlight: Susana López Huertas, Senior Account Manager

Cloudera

April is Autism Awareness Month, and as we close out the month I sat down with Clouderan Susana L ó pez Huertas, who shared her story of raising a son with autism and the work she is doing to promote an environment where autistic adults can thrive in the workforce. . Meet Susana L ó pez Huertas. Susana, who has been a part of Cloudera for about a year, works out of the Madrid office as a senior account manager for the country’s Telecom, Media, and Central Public Sector accounts.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Evolution of ML Fact Store

Netflix Tech

by Vivek Kaushal At Netflix, we aim to provide recommendations that match our members’ interests. To achieve this, we rely on Machine Learning (ML) algorithms. ML algorithms can be only as good as the data that we provide to it. This post will focus on the large volume of high-quality data stored in Axion?—?our fact store that is leveraged to compute ML features offline.

article thumbnail

How Metadata Improves Security, Quality, and Transparency

KDnuggets

Metadata is the data providing context about the data, more than what you see in the rows and columns. By managing your metadata, you're effectively creating an encyclopedia of your data assets.

Metadata 156
article thumbnail

Emerging Risks are Systemic

Teradata

Managing the new class of emerging risks requires infusing the principles of resiliency and efficient risk analytics into traditional risk management frameworks.

Systems 97
article thumbnail

Reflections of a Rockset UXer

Rockset

It is often said time flies when you are having fun and I couldn't agree more. I have been at Rockset for almost three years now and it is still so interesting to me. On one hand, I am just getting started and have so much more to do and on the other, I am so proud of the distance we have covered in the last few years! Photo by Daoudi Aissa on Unsplash Our customers tell us that the work we are doing matters to them: Rockset made me a hero on day three of my new job.

Medical 52
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

3 Simple Steps For Snowflake Cost Optimization Without Getting Too Crazy

Monte Carlo

Most data pros know Snowflake’s pricing model is consumption based–you pay for what you use. What many don’t know is Snowflake actually WANTS you to optimize your costs and has provided helpful features to rightsize your consumption. Waste isn’t good for anyone. Instead of spinning cycles on deteriorated SQL queries, the data cloud provider would rather have you focus those Snowflake credits toward projects like building data apps.

article thumbnail

A Simple Guide to Machine Learning Visualisations

KDnuggets

Create simple, effective machine learning plots with Yellowbrick.

article thumbnail

Operation-Based SLOs

Zalando Engineering

Anyone who has been following the topic of Site Reliability Engineering (SRE) has likely heard of Service Level Objectives (SLOs) , and Service Level Indicators (SLIs). SLIs and SLOs are at the core of the SRE practices. They are fundamental to establish the balance between building new features on a product, shipping fast, or working on the reliability of that product.

article thumbnail

Streaming Data and Real-Time Analytics With Kafka + Rockset

Rockset

As Kafka Summit is in full swing in London this week and the topic of event streaming is all over my Linkedin feed, I saw a post asking " Is streaming dead? " referring to CNN+ being shut down. In the last few days, Netflix took a once-in-a-lifetime beating in the stock market , and CNN redefined fail fast ( pioneered by Silicon Valley ) when it announced the breaking news that it will shut down CNN+ just weeks after a very splashy debut.

Kafka 52
article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Beyond Matrix Factorization: Using hybrid features for user-business recommendations

Yelp Engineering

Yelp’s mission is to connect people with great local businesses. On the Recommendations & Discovery team, we sift through billions of users-business interactions to learn user preferences. Our solutions power several products across Yelp such as personalized push notifications, email engagement campaigns, the home feed, Collections and more. Here we discuss the generalized user to business recommendation model which is crucial to a lot of these applications.

article thumbnail

Top Data Science Projects to Build Your Skills

KDnuggets

Check out this list of data science project ideas that you can use to boost your skills, organized by level of expertise.

article thumbnail

Scribd is presenting at Data and AI Summit 2022

Scribd Technology

We are very excited to be presenting and attending this year’s Data and AI Summit which will be hosted virtually and physically in San Francisco from June 27th-30th. Throughout the course of 2021 we completed a number of really interesting projects built around delta-rs and the Databricks platform which we are thrilled to share with a broader audience.

Kafka 40
article thumbnail

DataOps Explained: How To Not Screw It Up

Monte Carlo

What is DataOps? DataOps is a discipline that merges data engineering and data science teams to support an organization’s data needs, in a similar way to how DevOps helped scale software engineering. Similar to how DevOps applies CI/CD to software development and operations, DataOps entails a CI/CD-like, automation-first approach to building and scaling data products.

IT 64
article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Best Data Science Career Tracks of 2022

KDnuggets

Top-rated data science tracks consist of multiple project-based courses covering all aspects of data. It includes an introduction to Python/R, data ingestion & manipulation, data visualization, machine learning, and reporting.

article thumbnail

Data Management: How to Stay on Top of Your Customer’s Mind?

KDnuggets

Extract, profile, and manage your customer data in a flash with customer data management solutions, and achieve a customer-centric culture.

article thumbnail

MLOps: The Best Practices and How To Apply Them

KDnuggets

Here are some of the best practices for implementing MLOps successfully.

article thumbnail

High Availability SQL Server Docker Containers in Kubernetes

KDnuggets

Need high availability for SQL Server Docker containers in Kubernetes? Here’s how to get it.

SQL 108
article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

Connecting the Knowledge Ecosystem

KDnuggets

We’re proud to announce that the 4th annual Knowledge Graph Conference is taking place on May 2-6 at Cornell Tech, NYC and virtually on Airmeet.

108
108
article thumbnail

Why You Need To Learn Python In 2022

KDnuggets

If you don’t already know a programming language, or if you’re deciding to choose another language, have a read and see if Python is for you.

Python 108
article thumbnail

How Fast Can BERT Go With Sparsity?

KDnuggets

How much impact does sparsity have on model performance?

108
108
article thumbnail

KDnuggets News, April 27: A Brief Introduction to Papers With Code; Machine Learning Books You Need To Read In 2022

KDnuggets

A Brief Introduction to Papers With Code; Machine Learning Books You Need To Read In 2022; Building a Scalable ETL with SQL + Python; 7 Steps to Mastering SQL for Data Science; Top Data Science Projects to Build Your Skills.

article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.