Sat.Aug 17, 2024 - Fri.Aug 23, 2024

article thumbnail

10 Free Resources to Learn LLMs

KDnuggets

Learn large language models with these free resources from Deeplearning.AI, Microsoft, AWS, and more.

AWS 145
article thumbnail

Mapping the most popular National Park Service lands

ArcGIS

With a new GIS mapping tool you can map the most visited national parks (and much more!) to explore your spatial data even further.

Designing 145
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Onboarding your new AI/BI Genie

databricks

Deploying an AI/BI Genie is like hiring a new data analyst. This blog covers the basics you need to successfully onboard your Genie and maximize the benefits.

BI 131
article thumbnail

DAIS 2024: Unit tests - configuration and declaration

Waitingforcode

Code organization and assertions flow are both important but even them, they can't guarantee your colleagues' adherence to the unit tests. There are other user-facing attributes to consider as well.

Coding 130
article thumbnail

Apache Airflow® 101 Essential Tips for Beginners

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

article thumbnail

Pip Install YOU: A Beginner’s Guide to Creating Your Python Library

KDnuggets

Have you ever wanted to create your library in Python? Well, it’s achievable and surprisingly quite easy!

Python 136

More Trending

article thumbnail

Unlock Real-Time Cross-Platform Collaboration with Delta Sharing Tableau Connector

databricks

Special thanks to Kevin Glover, Martin Ko, Kuber Sharma and the team at Tableau for their valuable insights and contributions to this blog.

116
116
article thumbnail

What is a “Good” Data or Software Engineer?

Confessions of a Data Guy

Recently, for some unknown reason, I was pursuing the new Stackoverflow … called Reddit, for Data Engineering … and I ran across an interesting question … more or less it was related to “what makes a good Software Engineer … in a Data Engineering context.” This isn’t the first time this idea has come up […] The post What is a “Good” Data or Software Engineer?

article thumbnail

NumPy with Pandas for More Efficient Data Analysis

KDnuggets

Improve your Pandas processing with the NumPy package.

article thumbnail

Unlocking the Power of Geospatial AI with ArcGIS: Simplified and Advanced Solutions for Every User

ArcGIS

Discover how ArcGIS empowers users at all levels to harness the potential of geospatial AI. Whether you're leveraging pre-trained models for quick insights or building custom AI solutions, ArcGIS offers flexible, powerful tools for every workflow. Explore simplified and advanced AI capabilities across desktop, enterprise, and cloud environments, designed to make geospatial intelligence accessible to everyone.

Cloud 122
article thumbnail

Apache Airflow® Best Practices: DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

How PyTorch powers AI training and inference

Engineering at Meta

Learn about new PyTorch advancements for LLMs and how PyTorch is enhancing every aspect of the LLM lifecycle. In this talk from AI Infra @ Scale 2024 , software engineers Wanchao Liang and Evan Smothers are joined by Meta research scientist Kimish Patel to discuss our newest features and tools that enable large-scale training, memory efficient fine-tuning, and on-device LLM capabilities.

article thumbnail

Announcing the Pycharm Integration with Databricks

databricks

We are excited to announce the latest addition to the Databricks developer experience: the PyCharm Professional Integration with Databricks ! This new plugin.

106
106
article thumbnail

Top 5 Free Machine Learning Courses to Level Up Your Skills

KDnuggets

The article highlights five top free machine learning courses to enhance your skills.

article thumbnail

Use the Huff model to affirm site selection in Business Analyst Pro

ArcGIS

Did you catch the Huff model demo at UC 2024? Read this article for step-by-step instructions on the Business Analyst workflow.

article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Aparna Ramani discusses the future of AI infrastructure

Engineering at Meta

Delivering new AI technologies at scale also means rethinking every layer of our infrastructure – from silicon and software systems and even our data center designs. For the second year in a row, Meta’s engineering and infrastructure teams returned for the AI Infra @ Scale conference, where they discussed the challenges of scaling up an infrastructure for AI as well as work being done on our large-scale GPU clusters , open hardware designs for next-generation data center hardware, and how Meta i

article thumbnail

DevOps Roadmap: Your Guide to Become a DevOps Engineer

Edureka

If you’re curious about learning DevOps Roadmap but don’t know where to start, you’re in the right place! I’ll guide you step-by-step on your journey to becoming a DevOps engineer. First and foremost, we will start with the basic skills required to become a DevOps engineer, then gradually explore the major milestones you need to reach to succeed in this field.

article thumbnail

Building a Recommendation System with Hugging Face Transformers

KDnuggets

Learn how to build the recommendation system with advanced technology.

Systems 123
article thumbnail

What's new in Workflows?

databricks

Databricks Workflows is the cornerstone of the Databricks Data Intelligence Platform, serving as the orchestration engine that powers critical data and AI workloads.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Bringing Llama 3 to life

Engineering at Meta

Llama 3 is Meta’s most capable openly-available LLM to date and the recently-released Llama 3.1 will enable new workflows, such as synthetic data generation and model distillation with unmatched flexibility, control, and state-of-the-art capabilities that rival the best closed source models. At AI Infra @ Scale 2024 , Meta engineers discussed every step of how we built and brought Llama 3 to life, from data and training to inference.

article thumbnail

Full Stack Developer Skills, Salary and Jobs

Edureka

In the 21st century, Full Stack Web Development has undoubtedly transformed the internet. Notably, it is the driving force behind all the sites we see today, as well as mobile applications installed on our devices. Therefore, To succeed in web development, it’s important for anyone hoping to make a career out of it to understand and excel in the full stack developer skills required according to the current market trend.

article thumbnail

How to Conduct Time Series Analysis in R

KDnuggets

This article explains the basics of time series analysis. Learn to prepare your data and visualize trends in R.

Data 118
article thumbnail

Raise Your Tests: Testing Functional Kotlin with Arrow and Raise

Rock the JVM

By Riccardo Cardin At Rock the JVM, we deeply understand the power of the Kotlin Arrow library and the Raise DSL, and we’ve previously shared our insights in our article on Functional Error Handling in Kotlin, Part 3: The Raise DSL. Now, we’re ready to introduce the crucial topic of testing applications that use the Raise DSL. To fully grasp the concepts we’ll be discussing, it’s essential to have a solid understanding of Kotlin, Arrow library, and the Raise DSL.

article thumbnail

Apache Airflow® Crash Course: From 0 to Running your Pipeline in the Cloud

With over 30 million monthly downloads, Apache Airflow is the tool of choice for programmatically authoring, scheduling, and monitoring data pipelines. Airflow enables you to define workflows as Python code, allowing for dynamic and scalable pipelines suitable to any use case from ETL/ELT to running ML/AI operations in production. This introductory tutorial provides a crash course for writing and deploying your first Airflow pipeline.

article thumbnail

Inside the hardware and co-design of MTIA

Engineering at Meta

In this talk from AI Infra @ Scale 2024 , Joel Colburn, a software engineer at Meta, technical lead Junqiang Lan, and software engineer Jack Montgomery discuss the second generation of MTIA , Meta’s in-house training and inference accelerator. They cover the co-design process behind building the second generation of Meta’s first-ever custom silicon for AI workloads, including the PyTorch software ecosystem, and the model architectures for Meta’s key applications.

article thumbnail

AI Challenges and How Cloudera Can Help

Cloudera

By now, every organization, regardless of industry, has at least explored the use of AI, if not already embraced it. In today’s market, the AI imperative is firmly here, and failing to act quickly could mean getting left behind. But even as adoption soars, struggles remain, and scalability continues to be a major issue. Organizations are quick to adopt AI, but getting it established across the organization brings a unique set of challenges that come into play.

article thumbnail

5 Tips for Effective Data Visualization

KDnuggets

Looking to make your data visuals stand out? Check out these five tips for effective data visualization.

Data 115
article thumbnail

Advanced SQL for Data Science

Towards Data Science

Expert techniques to elevate your analysis Continue reading on Towards Data Science »

article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Databricks Marketplace Welcomes 47 New Data Providers in Q2 2024

databricks

Special thanks to David Gray @Epsilon, Tanishq Bhalla @HealthVerity, Itai Weiss @ Nimble, JB Kole @ Mostly.ai for their valuable insights and contributions.

Data 75
article thumbnail

Spring Into Confluent Cloud With Kotlin—Part 1: Producers and Consumers

Confluent

Get a full tutorial for interacting with Kafka on Confluent Cloud using the Spring Boot framework w/Kotlin. Includes Terraform and Stream Governance.

Cloud 75
article thumbnail

Cleaning and Preprocessing Text Data in Pandas for NLP Tasks

KDnuggets

A step-by-step guide to getting your raw text data nice and ready for Language Models and other NLP use cases!

Data 98