Sat.Dec 09, 2023 - Fri.Dec 15, 2023

article thumbnail

Enhancing LLM Reasoning: Unveiling Chain of Code Prompting

KDnuggets

Chain of Code is an approach to interacting with language models, enhancing reasoning abilities through a blend of writing, executing, and simulating code execution, extending the capabilities of language models in logic, arithmetic, and linguistic tasks, especially those requiring a combination of these.

Coding 155
article thumbnail

Even Santa Claus has AI fever

databricks

As CEO of the North Pole, Santa Claus oversees one of the world’s most complicated supply chain, manufacturing and logistics operations. Every year, S.

article thumbnail

Uplevel your dbt workflow with these tools and techniques

Start Data Engineering

1. Introduction 2. Setup 3. Ways to uplevel your dbt workflow 3.1. Reproducible environment 3.1.1. A virtual environment with Poetry 3.1.2. Use Docker to run your warehouse locally 3.2. Reduce feedback loop time when developing locally 3.2.1. Run only required dbt objects with selectors 3.2.2. Use prod datasets to build dev models with defer 3.2.3. Parallelize model building by increasing thread count 3.

Datasets 130
article thumbnail

Data+AI Summit 2023, retrospective part 2

Waitingforcode

One week later than initially announced, but here it is, the second part for Data+AI Summit 2023 retrospective. I don't know how, but I managed to include some streaming-related talks here too!

Data 130
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Undersampling Techniques Using Python

KDnuggets

The article discusses the undersampling data preprocessing techniques to address data imbalance challenges.

Python 151
article thumbnail

Lakehouse Monitoring: A Unified Solution for Quality of Data and AI

databricks

Introduction Databricks Lakehouse Monitoring allows you to monitor all your data pipelines – from data to features to ML models – without additional too.

More Trending

article thumbnail

Run Your Own Anomaly Detection For Your Critical Business Metrics With Anomstack

Data Engineering Podcast

Summary If your business metrics looked weird tomorrow, would you know about it first? Anomaly detection is focused on identifying those outliers for you, so that you are the first to know when a business critical dashboard isn't right. Unfortunately, it can often be complex or expensive to incorporate anomaly detection into your data platform. Andrew Maguire got tired of solving that problem for each of the different roles he has ended up in, so he created the open source Anomstack project.

Data Lake 130
article thumbnail

7 Pandas Plotting Functions for Quick Data Visualization

KDnuggets

Want to visualize data in your pandas dataframes? Use these nifty pandas plotting functions.

Data 150
article thumbnail

Build GenAI Apps Faster with New Foundation Model Capabilities

databricks

Following the announcements we made last week about Retrieval Augmented Generation (RAG), we're excited to announce major updates to Model Serving. Databricks Model.

Building 133
article thumbnail

Big improvements for field management in Geoprocessing in ArcGIS Pro 3.2

ArcGIS

In ArcGIS Pro 3.2, the field map parameter has been redesigned for improved usability and new capabilities.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Making Flink Serverless, With Queries for Less Than a Penny

Confluent

Dive into the serverless architecture of Confluent Cloud for Apache Flink and explore its benefits like reduced infrastructure costs, increased reliability, & seamless adoption.

article thumbnail

5 Free University Courses to Learn Python

KDnuggets

Looking for the best resources to learn Python programming? Check out these free university courses.

Python 149
article thumbnail

Offline LLM Evaluation: Step-by-Step GenAI Application Assessment on Databricks

databricks

Background In an era where Retrieval-Augmented Generation (RAG) is revolutionizing the way we interact with AI-driven applications, ensuring the efficiency and effectiveness of.

article thumbnail

Layout sandwich

ArcGIS

How to make a layout sandwich with two synchronized map views, some masking, and some mischief.

121
121
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Real-Time Field Service Optimization

Confluent

Telcos use Confluent with event-driven microservices to enable real-time communications with 3rd-party field service providers, fulfilling customer service requests more efficiently.

110
110
article thumbnail

5 Rare Data Science Skills That Can Help You Get Employed

KDnuggets

This article is about the less common data science skills that can help you get hired. While these skills are not as common as they are for technical jobs, they are certainly worth developing.

article thumbnail

Managing AI Security Risks: Introducing a new workshop for CISOs

databricks

Adopting AI is existentially vital for most businesses Machine Learning (ML) and generative AI (GenAI) are revolutionizing the future of work. Organizations understand.

article thumbnail

Tips for labeling images for object detection models

ArcGIS

In this Part-1 of a two-part blog series, we will share tips for labeling objects on images for object detection deep learning models.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Our First Netflix Data Engineering Summit

Netflix Tech

Holden Karau Elizabeth Stone Pedro Duarte Chris Stephens Pallavi Phadnis Lee Woodridge Mark Cho Guil Pires Sujay Jain Tristan Reid Senthilnathan Athinarayanan Bharath Mummadisetty Abhinaya Shetty Judit Lantos Amanuel Kahsay Dao Mi Mick Dreeling Chris Colburn and Agata Gryzbek Introduction Earlier this summer Netflix held our first-ever Data Engineering Forum.

article thumbnail

AI in Intimate Roles: Girlfriends and Therapists

KDnuggets

This article is a brief overview of the field of Emotion AI, and the potential applications of its technology in intimate roles.

article thumbnail

Delivering cost-effective data in real time with dbt and Databricks

databricks

As businesses grow, data volumes scale from GBs to TBs (or more), and latency demands go from hours to minutes (or less), making.

Data 105
article thumbnail

ArcGIS AI Models – Year in Review

ArcGIS

Learn about our recently released pretrained deep learning models available in the ArcGIS Living Atlas of the World.

article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Predictions: The Cybersecurity Challenges of AI

Snowflake

Our recently released predictions report includes a number of important considerations about the likely trajectory of cybercrime in the coming years, and the strategies and tactics that will evolve in response. Every year, the story is “Attackers are getting more sophisticated, and defenders have to keep up.” As we enter a new era of advanced AI technology, we identify some surprising wrinkles to that perennial trend.

article thumbnail

3 Ways to Generate Hyper-Realistic Faces Using Stable Diffusion

KDnuggets

You learned how to generate images using the base model, how to upgrade to the Stable Diffusion XL model to improve image quality, and how to use a custom model to generate high quality portraits.

145
145
article thumbnail

Databricks @ AFROTECH

databricks

"AFROTECH was not only insightful, but also greatly heightened my sense of belonging in the tech space! It was amazing to both make.

IT 104
article thumbnail

Big improvements for field management in Geoprocessing in ArcGIS Pro 3.2

ArcGIS

In ArcGIS Pro 3.2, the field map parameter has been redesigned for improved usability and new capabilities.

article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

Unapologetically Technical Episode 7 – Stephane Derosiaux

Jesse Anderson

What better year to start the Christmas season than to drop a new episode of Unapologetically Technical! In this episode, I interview Stephane Derosiaux from Conduktor. We talk about his time evolving architectures and creating real-time systems at Auchan (grocery) and Adeo/Leroy Merlin (Home Improvement). We discuss the issues of British food and how to find good food in London.

Food 100
article thumbnail

5 Tools to Help Build Your LLM Apps

KDnuggets

Whether you're a seasoned ML engineer or a new LLM developer, these tools will help you get more productive and accelerate the development and deployment of your AI projects.

Building 145
article thumbnail

#Volunteer Spotlight: Remus Lim

Cloudera

During Week of Giving Clouderans across the globe took time out of their busy schedules to give back and support causes meaningful to them. For many colleagues, however, giving and volunteering during Week of Giving is just one of the many ways they support the causes meaningful to them. We had the privilege of sitting down with Remus Lim, Regional VP of Sales in APAC who not only volunteered alongside his Singapore-based colleagues during Week of Giving but is dedicating an upcoming trip to phi

IT 96
article thumbnail

New Snowflake Features Released in September–November 2023

Snowflake

At our recent Snowday event, we announced a wave of Snowflake product innovations for easier application development, new AI and LLM capabilities, better cost management and more. If you missed the event or need a refresh of what was presented, watch any Snowday session on demand. Let’s dive into all new releases in September, October and November. Architecture Flexibility Iceberg Tables – public preview While many customers value the simplicity of fully managed storage and a single, mul

article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.