Analytics Vidhya

FEBRUARY 28, 2024

Introduction Data is fuel for the IT industry and the Data Science Project in today’s online world. IT industries rely heavily on real-time insights derived from streaming data sources. Handling and processing the streaming data is the hardest work for Data Analysis. We know that streaming data is data that is emitted at high volume […] The post Kafka to MongoDB: Building a Streamlined Data Pipeline appeared first on Analytics Vidhya.

MongoDB 217

MongoDB Data Pipeline Kafka Building 217

KDnuggets

FEBRUARY 28, 2024

Begin your data professional journey from the basics of statistics to building a production-grade AI application.

Machine Learning 160

Machine Learning Data Science Data Engineer Data Engineering 160

databricks

FEBRUARY 28, 2024

This post is the second part of our two-part series on the latest performance improvements of stateful pipelines. The first part of this.

Data Engineer 111

Data Engineer Data Engineering Engineering Data 111

KDnuggets

FEBRUARY 28, 2024

Exploring the limitless possibilities of AI and making it context-aware.

Deep Learning 157

Deep Learning Database IT 157

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Knowledge Hut

FEBRUARY 28, 2024

A business analyst ensures that the end product meets the requirements and parameters of project's stakeholders. Business analyst holds the responsibility to gather the requirements through streamlined communication with stakeholders and to make the sense of collected information in order to help the project team complete the tasks successfully. The most challenging and wide-scoped task of BA is to give the users what they want instead of giving what they need during requirements gathering.

Business Analyst 98

Business Analyst Data Science Project Designing 98

KDnuggets

FEBRUARY 28, 2024

AI Con USA is scheduled for June 2-7 in Las Vegas, and it's bringing together some of the brightest minds in the realm of artificial intelligence and machine learning.

Machine Learning 139

Machine Learning IT 139

Snowflake

FEBRUARY 28, 2024

Welcome to Snowflake’s Startup Spotlight, where we learn about awesome companies building businesses on Snowflake. In this edition, find out how Angad Singh, co-founder and CEO of Chabi , is working to give every company the chance to become data-driven with a modern data stack. How would you explain Chabi? Chabi is your all-in-one data stack with state-of-the-art, built-in data warehouse, ETL, data modeling and personalized analytics that are tailored to meet your unique data and BI needs.

BI 93

BI Data Warehouse Accessibility Accessible 93

Cloudera

FEBRUARY 28, 2024

Businesses often need to aggregate topics because it is essential for organizing, simplifying, and optimizing the processing of streaming data. It enables efficient analysis, facilitates modular development, and enhances the overall effectiveness of streaming applications. For example, if there are separate clusters, and there are topics with the same purpose in the different clusters, then it is useful to aggregate the content into one topic.

Kafka 74

Kafka Management Big Data Architecture 74

Confluent

FEBRUARY 28, 2024

Kafka Summit London 2024 brings 90+ sessions, keynotes, lightning talks, and more from industry leaders. Check out the agenda, highlights, networking events, and more event info.

Kafka 69

Kafka 69

Tweag

FEBRUARY 28, 2024

Tweag developed rules_nixpkgs to empower Bazel users with the ability to leverage Nix’s reproducible builds and its extensive package registry. That ruleset has proven to be especially advantageous in endeavors demanding intricate dependency administration and the maintenance of uniform build environments. However, rules_nixpkgs is incompatible with remote execution.

Building 64

Building AWS Accessibility Accessible 64

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

DareData

FEBRUARY 28, 2024

In this post of the PyTorch Introduction, we’ll learn how to use custom datasets with PyTorch, particularly tabular, vision and text data PyTorch is one of the hottest libraries in the Deep Learning field right now. Since ChatGPT’s release, deep learning libraries have arguably garnered the most attention among data scientists and machine learning engineers, particularly due to the current practical applications they enable.

Datasets 52

Datasets Deep Learning Data Machine Learning 52

FreshBI

FEBRUARY 28, 2024

Since Adam there have been 4 commandments of project management. Project Managers who can answer these questions on demand will succeed. Project Managers who cannot answer these questions on demand will fail. In the modern world of business, Project Managers making data-driven decisions will boast successful, profitable, and high-cash projects. The 4 commandments for Project Management are: Be On Time Be On Budget Adequately Plan Materials and Labor Adequately Plan for Sufficient Cash Runway Be

Project 52

Project Management Utilities Recruitment 52

Ascend.io

FEBRUARY 28, 2024

The rise of generative AI is changing more than just technology; it’s reshaping our professional landscapes — and yes, data engineering is directly experiencing the impact. How does AI recalibrate the workload and priorities of data teams? Does it serve merely as an enhancement to the skills of data professionals, or does it redefine their roles entirely?

Data Engineer 52

Data Engineer Data Engineering Engineering Metadata 52

Knowledge Hut

FEBRUARY 28, 2024

The Certified Business Analysis Professional is a course offered by the International Institute of Business Analysis (IIBA) and can establish you as a certified business analyst in the global market. If you’re planning to get CBA certified, here’s how you can go about doing it. Apply For The Exam Applying for CBA exam is the first thing that you need to do.

Business Analyst 52

Business Analyst Data Science Certification Project 52

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Knowledge Hut

FEBRUARY 28, 2024

The ability to track multiple key performance indicators (KPIs) and metrics is critical to business success today. It is not feasible to analyze and interpret large amounts of data manually. Data visualization has become vital to understanding the various trends present in the data – both visible, as well as hidden trends. Dashboards showcase visual trends and information such as KPIs (Key performance metrics), trends, filters, and forecasts.

BI 52

BI Business Intelligence Data Data Science 52

Knowledge Hut

FEBRUARY 28, 2024

From the moment we wake up in the morning till we go back to sleep, our lives run on data. It is almost like we are living deep inside the matrix and have no idea how to get out. Big data has enabled us to accelerate growth and development and reach a new phase for humanity. Things that would have been unimaginable a few centuries ago are now well within our grasp.

Big Data 52

Big Data Cloud Storage Healthcare SQL 52