KDnuggets

MAY 8, 2024

Want to build cool AI applications? Start learning AI today with these free courses from NVIDIA.

Building 158

Building 158

Data Engineering Podcast

MAY 5, 2024

Summary Artificial intelligence has dominated the headlines for several months due to the successes of large language models. This has prompted numerous debates about the possibility of, and timeline for, artificial general intelligence (AGI). Peter Voss has dedicated decades of his life to the pursuit of truly intelligent software through the approach of cognitive AI.

Building 147

Building Data Lake High Quality Data Machine Learning 147

ArcGIS

MAY 7, 2024

Discover the exciting new features of ArcGIS Pro 3.3. From water flow modeling to direct PDF support, this release has it all. Read our blog to learn more.

IT 144

IT 144

Snowflake

MAY 7, 2024

Snowflake Cortex is a fully-managed service that enables access to industry-leading large language models (LLMs) is now generally available. You can use these LLMs in select regions directly via LLM Functions on Cortex so you can bring generative AI securely to your governed data. Your team can focus on building AI applications, while we handle model optimization and GPU infrastructure to deliver cost-effective performance.

Government 130

Government SQL Data Security Accessible 130

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

KDnuggets

MAY 9, 2024

Learn how to generate super fast responses in Jan AI and VSCode using Groq LPU Inference Engine.

Engineering 151

Engineering 151

Start Data Engineering

MAY 9, 2024

1. Introduction 2. Snowflake pricing and settings inheritance model 3. Strategies to reduce Snowflake cost 3.1. Quick wins by changing settings 3.1.1. Update warehouse settings 3.2. Analyze usage and optimize table data storage 3.2.1. Identify expensive queries and optimize them 3.2.1.1. Identify expensive queries with query_history 3.2.1.2. Optimize expensive queries 3.2.2.

Data Storage 130

Data Storage Accessible Accessibility Management 130

Seattle Data Guy

MAY 7, 2024

Getting data out of source systems and into a data warehouse or data lake is one of the first steps in making it usable by analysts and data scientists. The question is how will your team do that? Will they write custom data connectors, pay for a data connector out of the box or perhaps… Read more The post 4 ELT Alternatives To Airbyte – How To Ingest Your Data appeared first on Seattle Data Guy.

Data Lake 130

Data Lake Data Warehouse Data Systems 130

KDnuggets

MAY 8, 2024

The goal of this article is to help demystify the process of selecting the proper machine learning algorithm, concentrating on "traditional" algorithms and offering some guidelines for choosing the best one for your application.

Machine Learning 150

Machine Learning Algorithm Process 150

ArcGIS

MAY 8, 2024

Read a summary of the newest features, enhancements, and improvements in the ArcGIS Business Analyst Pro May Release.

Business Analyst 120

Business Analyst Designing 120

Waitingforcode

MAY 7, 2024

I wrote a blog post about OutputModes 6 (yes!) years ago and after reading it a few times, I realized it was not good enough to be a quick refresher. For that reason you can read about OutputModes for the second time here. Hopefully, this one will be a good try!

IT 130

IT 130

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

Snowflake

MAY 9, 2024

From its start with efficient batch processing with data warehouses for descriptive analytics, and the inclusion of streaming data in real time to build recommendations, we find ourselves at the forefront of a new stage of evolution: generative AI (gen AI). This generative powerhouse has fueled vertical integration, giving rise to industry-specific solutions that harness the full potential of generative capabilities and unlocked the imagination of many.

Unstructured Data 118

Unstructured Data Manufacturing Retail Data Warehouse 118

KDnuggets

MAY 7, 2024

Want to run large language models on your machine? Learn how to do so using Ollama in this quick tutorial.

Machine Learning 149

Machine Learning 149

databricks

MAY 8, 2024

In December, we announced a new suite of tools to get Generative AI applications to production using Retrieval Augmented Generation (RAG). Since then.

Data Science 117

Data Science Data 117

ArcGIS

MAY 9, 2024

ArcGIS's capabilities for visualizing and analyzing EMIT hyperspectral imagery bridge the gap between NASA's science data and GIS users.

Data 111

Data 111

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

Snowflake

MAY 6, 2024

Snowflake is dedicated to providing customers with intuitive solutions that streamline their operations and drive success. As part of our ongoing commitment to helping customers in this way, we’re introducing updates to the Cost Management Interface to make managing Snowflake spend easier at an organization level and accessible to more roles. Snowsight: Your Centralized Console for Cost Management The Cost Management Interface in Snowsight (Snowflake’s web interface) is the centralized con

Management 110

Management Finance Accessible Accessibility 110

KDnuggets

MAY 10, 2024

Master AI with these free courses from Harvard, Google, AWS, and more.

AWS 148

AWS 148

databricks

MAY 6, 2024

Discover the vital role of data governance in the communications, media, and entertainment industry. Learn how robust data governance enables personalized experiences, ensures AI transparency, and mitigates compliance risks. Explore how leading companies like Barilla and Anker are accelerating innovation through effective data governance strategies powered by Databricks' Unity Catalog.

Entertainment 110

Entertainment Media Data Governance Government 110

ArcGIS

MAY 9, 2024

Watch this short video to learn how to choose color schemes that work well with light or dark basemaps.

Designing 109

Designing 109

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

Snowflake

MAY 8, 2024

There are more than 25,000 SnowPros in the Snowflake Certification community today. Earning and maintaining a SnowPro Certification shows a strategic commitment to expand your Snowflake knowledge and skills, and advance your career. As Snowflake continues to grow, the demand for Snowflake experience and expertise is also rapidly increasing. A recent survey of certified SnowPros indicated that: 68% received positive recognition for achieving the certification. 61% noted a greater demand for their

Programming 110

Programming Certification Data Engineering Data Engineer 110

KDnuggets

MAY 6, 2024

Data analyst tools encompass programming languages, spreadsheets, BI, and big data tools. Here are 9ish tools that cover all the tasks of data analysts well.

Programming Language 143

Programming Language Big Data Tools BI Big Data 143

Robinhood

MAY 6, 2024

Robinhood Markets,Inc.(Nasdaq:HOOD) today announced that RHC has received a Wells Notice from the SEC Staff Earlier today we announced Robinhood Crypto (RHC) has received a Wells Notice from the U.S. Securities and Exchange Commission staff indicating they will recommend that the Commission file an enforcement action. “After years of good faith attempts to work with the SEC for regulatory clarity including our well-known attempt to ‘come in and register,’ we are disappointed that the agency has

109

109

ArcGIS

MAY 9, 2024

ArcGIS Pro 3.3 boosts Image Analyst's AI power! Dive into the new GeoAI features for smarter image analysis.

107

107

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineering

databricks

MAY 9, 2024

Last year, we launched foundation model support in Databricks Model Serving to enable enterprises to build secure and custom GenAI apps on a.

Building 105

Building Machine Learning Data Science Data 105

KDnuggets

MAY 6, 2024

Want to learn more about Artificial Intelligence? These five courses from Stanford will help you kickstart that journey.

142

142

Snowflake

MAY 7, 2024

Accelerate Healthcare and Life Sciences is a one-day virtual event, featuring technology and business leaders from Elevance Health, Ginkgo Bioworks, Datavant and more, to discover executive priorities, best practices and potential data and AI challenges that are top of mind for 2024. Why Attend Accelerate Healthcare and Life Sciences? Accelerate Healthcare and Life Sciences is on May 16, 2024, starting at 11 a.m.

Healthcare 105

Healthcare Cloud Data Technology 105

Cloudera

MAY 10, 2024

Apache Iceberg is vital to the work we do and the experience that the Cloudera platform delivers to our customers. Iceberg, a high-performance open-source format for huge analytic tables, delivers the reliability and simplicity of SQL tables to big data while allowing for multiple engines like Spark, Flink, Trino, Presto, Hive, and Impala to work with the same tables, all at the same time.

Government 103

Government Data Governance Big Data Data Pipeline 103

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

databricks

MAY 7, 2024

The Data Team Awards celebrates enterprise data teams' essential role in helping businesses across sectors face their most pressing challenges. With more than.

Data 105

Data 105

KDnuggets

MAY 9, 2024

Enrich your knowledge with these papers

Machine Learning 138

Machine Learning 138

Knowledge Hut

MAY 10, 2024

As of the beginning of January 2022, India has recognized more than 61,000 startups, thus having the 3rd largest startup ecosystem after the US and China. The government of India has an initiative called Startup India, whose sole purpose is to bring about startup culture and build an ecosystem for entrepreneurship and innovation. As a result, the startup ecosystem in India has emerged as a major growth engine for the country in the past few years and aims to become a global tech powerhouse.

Insurance 98

Insurance Medical Food Retail 98

Cloudera

MAY 9, 2024

The Gartner Data and Analytics Summit in London is quickly approaching on May 13 th to 15 th , and the Cloudera team is ready to hit the show floor! The theme of this year’s summit, “Generating Value Together: Creating Synergies between Data, Analytics & AI,” could not have come at a better time as we push forward on our AI and analytics journey together.

Banking 102

Banking Data Storage Data Analytics Cloud 102

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

Software Engineer