Engineering at Meta

DECEMBER 3, 2024

Meta releases a Request for Proposals (RFP) to identify nuclear energy developers to support AI innovation and clean and renewable energy goals.

Engineering 145

Engineering Data 145

KDnuggets

DECEMBER 4, 2024

Learn to build, run, and manage data engineering pipelines both locally and in the cloud using popular tools.

Data Engineering 140

Data Engineering Data Engineer Engineering Project 140

databricks

DECEMBER 1, 2024

We are excited to announce the Public Preview of Cross-Platform View Sharing. Available today, it allows data providers to share views across different.

IT 117

IT Data 117

Confessions of a Data Guy

DECEMBER 6, 2024

Well, everyone is abuzz with the recently announced S3 Tables that came out of AWS reinvent this year. I’m going to call fools gold on this one right out of the gate. I tried them out, in real life that is, not just some marketing buzz, and it will leave most people, not all, be […] The post AWS S3 Tables. Technical Introduction. appeared first on Confessions of a Data Guy.

AWS 130

AWS Data IT Big Data 130

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Seattle Data Guy

DECEMBER 3, 2024

When I broke into the data world, everyone wanted to hire data scientists that would let their companies become more data driven. There were statistics about the exabytes of data that we were creating and the value it would provide. However, a few years into my career, the data world started to make a pivot… Read more The post Preparing Your Data Infrastructure for 2025: Lessons from the Past, Strategies for the Future appeared first on Seattle Data Guy.

Data 130

Data IT 130

KDnuggets

DECEMBER 2, 2024

Learn reinforcement learning using free resources, including books, frameworks, courses, tutorials, example code, and projects.

Coding 140

Coding Project 140

Cloudera

DECEMBER 4, 2024

For more than a decade, Cloudera has been an ardent supporter and committee member of Apache NiFi, long recognizing its power and versatility for data ingestion, transformation, and delivery. Our customers rely on NiFi as well as the associated sub-projects (Apache MiNiFi and Registry) to connect to structured, unstructured, and multi-modal data from a variety of data sources – from edge devices to SaaS tools to server logs and change data capture streams.

Data Pipeline 92

Data Pipeline Data Ingestion Data Preparation Architecture 92

Engineering at Meta

DECEMBER 2, 2024

Andromeda is Meta’s proprietary machine learning (ML) system design for retrieval in ad recommendation focused on delivering a step-function improvement in value to our advertisers and people. This system pushes the boundary of cutting edge AI for retrieval with NVIDIA Grace Hopper Superchip and Meta Training and Inference Accelerator (MTIA) hardware through innovations in ML model architecture, feature representation, learning algorithm, indexing, and inference paradigm.

Engineering 82

Engineering Algorithm Utilities Machine Learning 82

KDnuggets

DECEMBER 2, 2024

In this article, we’ll go over Python libraries for tasks like logging, unit testing, data handling, and more — each with features that can simplify your application development.

Python 125

Python Data 125

databricks

DECEMBER 3, 2024

The world of artificial intelligence (AI) and data analytics is about to get a significant boost, thanks to Databricks’ collaboration with NVIDIA. This.

Data Analytics 107

Data Analytics Data 107

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Cloudera

DECEMBER 4, 2024

Today enterprises can leverage the combination of Cloudera and Snowflake—two best-of-breed tools for ingestion, processing and consumption of data—for a single source of truth across all data, analytics, and AI workloads. But now AWS customers will gain more flexibility, data utility, and complexity, supporting the modern data architecture. All this by making it easier for customers to connect their workloads with Snowflake, Cloudera, and unique AWS services such as Amazon Simple Storage Service

AWS 89

AWS Raw Data Relational Database Government 89

Snowflake

DECEMBER 4, 2024

Snowflake leaders offer insight on AI, open source and cybersecurity development — and the fundamental leadership skills required — in the years ahead. As we come to the end of a calendar year, it’s natural to contemplate what the new year will hold for us. It’s an understatement to say that the future is very hard to predict, but it’s possible to both prepare for the likeliest outcomes and stay ready to adapt to the unexpected.

Unstructured Data 68

Unstructured Data Data Lake Deep Learning Structured Data 68

KDnuggets

DECEMBER 4, 2024

Here are five free resources in diverse formats and difficulty levels to acquaint with deep learning models at no cost.

Deep Learning 116

Deep Learning 116

databricks

DECEMBER 4, 2024

In recent years, artificial intelligence has transformed from an aspirational technology to a driver of manufacturing innovation and efficiency. Understanding both the current.

Manufacturing 100

Manufacturing Technology Data 100

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Cloudera

DECEMBER 4, 2024

Welcome to the first installment of a series of posts discussing the recently announced Cloudera AI Inference service. Today, Artificial Intelligence (AI) and Machine Learning (ML) are more crucial than ever for organizations to turn data into a competitive advantage. To unlock the full potential of AI, however, businesses need to deploy models and AI applications at scale, in real-time, and with low latency and high throughput.

Architecture 72

Architecture BI Machine Learning Deep Learning 72

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. According to recent research, 95% of data teams are operating at or over capacity, highlighting the urgent need for strategic preparation. This isn’t just about keeping up; it’s about staying ahead so that data teams can deliver the data needed to fuel their organizations.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

KDnuggets

DECEMBER 6, 2024

104

104

databricks

DECEMBER 5, 2024

At Databricks, AutoML is our low-code/no-code model training API that empowers customers to create quality machine learning (ML) models with their data on.

Machine Learning 98

Machine Learning Coding Data 98

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Cloudera

DECEMBER 2, 2024

As organizations adopt a cloud-first infrastructure strategy, they must weigh a number of factors to determine whether or not a workload belongs in the cloud. Cost has been a key consideration in public cloud adoption from the start. Today, energy efficiency is gaining importance, not only for cutting costs but also as a vital step toward sustainable business practices.

AWS 83

AWS Amazon Web Services Cloud Computing Utilities 83

Snowflake

DECEMBER 5, 2024

60

60

KDnuggets

DECEMBER 4, 2024

MongoDB is a database that’s great for handling large amounts of diverse data. This article walks you through installing MongoDB and using the MongoDB Shell to manage your data easily.

MongoDB 108

MongoDB Database Management Data 108

databricks

DECEMBER 3, 2024

We’re thrilled to announce that Databricks has been recognized as a winner in multiple categories at the 2024 AWS Partner of the Year.

AWS 97

AWS 97

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Cloudera

DECEMBER 3, 2024

Many enterprises have heterogeneous data platforms and technology stacks across different business units or data domains. For decades, they have been struggling with scale, speed, and correctness required to derive timely, meaningful, and actionable insights from vast and diverse big data environments. Despite various architectural patterns and paradigms, they still end up with perpetual “data puddles” and silos in many non-interoperable data formats.

Metadata 71

Metadata SQL Database Data Warehouse 71

Confluent

DECEMBER 4, 2024

Tableflow easily integrates with Amazon SageMaker Lakehouse, enabling you to quickly materialize your Apache Kafka topics into Iceberg tables stored in S3.

Kafka 59

Kafka Data Process 59

KDnuggets

DECEMBER 3, 2024

Check out these key concepts, tools, jargon, and tips for integrating ML models into existing software systems.

Machine Learning 107

Machine Learning Systems 107

databricks

DECEMBER 2, 2024

Executive Summary In this blog post we explore how private equity (PE) firms can leverage data intelligence to enhance portfolio returns. We highlight.

Portfolio 91

Portfolio Data 91

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Cloudera

DECEMBER 6, 2024

Artificial Intelligence promises to transform lives and business as we know it. But what does that future look like? The AI Forecast: Data and AI in the Cloud Era , sponsored by Cloudera, aims to take an objective look at the impact of AI on business, industry, and the world at large. Hosted weekly by Paul Muller, The AI Forecast speaks to experts in the space to understand the ins and outs of AI in the enterprise, the kinds of data architectures and infrastructures that support it, the guardrai

Manufacturing 61

Manufacturing Retail Finance Metadata 61

Elder Research

DECEMBER 4, 2024

Take a break from the usual routine and join thousands of data professionals for Advent of Code. It's a great way to sharpen your skills!

Coding 59

Coding Data IT 59

KDnuggets

DECEMBER 5, 2024

Let’s take a look at a concise roadmap to building a lasting and effective machine learning career.

Machine Learning 99

Machine Learning Building Computer Science Technology 99

databricks

DECEMBER 2, 2024

Predictive Optimization (PO) enhances the performance of Unity Catalog managed tables by intelligently optimizing data layouts, leading to significant improvements in query performance.

Management 79

Management Data 79

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems