KDnuggets

MAY 7, 2024

Want to run large language models on your machine? Learn how to do so using Ollama in this quick tutorial.

Machine Learning 149

Machine Learning 149

ArcGIS

MAY 7, 2024

Discover the exciting new features of ArcGIS Pro 3.3. From water flow modeling to direct PDF support, this release has it all. Read our blog to learn more.

IT 144

IT 144

Snowflake

MAY 7, 2024

Snowflake Cortex is a fully-managed service that enables access to industry-leading large language models (LLMs) is now generally available. You can use these LLMs in select regions directly via LLM Functions on Cortex so you can bring generative AI securely to your governed data. Your team can focus on building AI applications, while we handle model optimization and GPU infrastructure to deliver cost-effective performance.

Government 132

Government SQL Data Security Accessibility 132

Waitingforcode

MAY 7, 2024

I wrote a blog post about OutputModes 6 (yes!) years ago and after reading it a few times, I realized it was not good enough to be a quick refresher. For that reason you can read about OutputModes for the second time here. Hopefully, this one will be a good try!

IT 130

IT 130

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

Seattle Data Guy

MAY 7, 2024

Getting data out of source systems and into a data warehouse or data lake is one of the first steps in making it usable by analysts and data scientists. The question is how will your team do that? Will they write custom data connectors, pay for a data connector out of the box or perhaps… Read more The post 4 ELT Alternatives To Airbyte – How To Ingest Your Data appeared first on Seattle Data Guy.

Data Lake 130

Data Lake Data Warehouse Data Systems 130

KDnuggets

MAY 7, 2024

Explore __contains__ and __iter__ magic methods, which are essential for implementing iteration functionality for custom classes.

Python 128

Python 128

Snowflake

MAY 7, 2024

Accelerate Healthcare and Life Sciences is a one-day virtual event, featuring technology and business leaders from Elevance Health, Ginkgo Bioworks, Datavant and more, to discover executive priorities, best practices and potential data and AI challenges that are top of mind for 2024. Why Attend Accelerate Healthcare and Life Sciences? Accelerate Healthcare and Life Sciences is on May 16, 2024, starting at 11 a.m.

Healthcare 105

Healthcare Cloud Data Technology 105

Towards Data Science

MAY 7, 2024

A list to make evaluating ELT/ETL tools a bit less daunting Photo by Volodymyr Hryshchenko on Unsplash We’ve all been there: you’ve attended (many!) meetings with sales reps from all of the SaaS data integration tooling companies and are granted 14 day access to try their wares. Now you have to decide what sorts of things to test in order to figure out definitively if the tool is the right commitment for you and the team.

ETL Tools 98

ETL Tools Metadata Data Integration Data Science 98

ArcGIS

MAY 7, 2024

ArcGIS Bathymetry introduces three new tools and enhances Compose Surface capabilities in ArcGIS Pro 3.

Government 92

Government 92

Cloudera

MAY 7, 2024

Organizations are challenged today to become both more data driven and more nimble to adapt quickly to changing conditions. These challenges are the driving forces behind much of their digital transformation or “modernization” efforts. Digital Transformation is defined as the process of integrating digital technology into all areas of a business to create and capture value in new ways, effectively “datifying” all processes while remaining agile enough to make continuous incremental improvements

Kafka 72

Kafka Data Lake Cloud Computing Cloud 72

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

DataKitchen

MAY 7, 2024

DataKitchen Training And Certification Offerings For Individual contributors with a background in Data Analytics/Science/Engineering Overall Ideas and Principles of DataOps DataOps Cookbook (200 page book over 30,000 readers, free): DataOps Certificatio n (3 hours, online, free, signup online): DataOps Manifesto (over 30,000 signatures) One Day DataOps training (paid) Data Observability (the first step in DataOps) I deas and Principles of Data Observability Four-part Da

Certification 65

Certification Consulting Data Analytics Engineering 65

Scott Logic

MAY 7, 2024

Businesses today want to keep an eye on their carbon emissions and do their bit to help the climate crisis and so they need to understand and reduce all their emissions including those from cloud computing. You might imagine that the cloud providers with their omniscient observability would be able to provide accurate, real time carbon and energy reporting to each of their customers.

Cloud 52

Cloud Java AWS Coding 52

Cloudyard

MAY 7, 2024

Read Time: 1 Minute, 39 Second Many organizations leverage Snowflake stages for temporary data storage. However, with ongoing data ingestion and processing, it’s easy to lose track of stages containing old, potentially unnecessary data. This can lead to wasted storage costs. You want to implement a monitoring solution to track the storage usage of each internal stage and identify stages with stale data files.

Data Ingestion 52

Data Ingestion Data Storage Utilities Coding 52

Ascend.io

MAY 7, 2024

Strategic partnership to deliver significant enhancements in efficiency, security, and modernization with advanced AI technology solutions & services SAN FRANCISCO, CA, May 7, 2024 – Wizeline, a leading AI-powered software engineering company, and Ascend.io, a pioneer in data pipeline automation, today announced a partnership that redefines the landscape of data management and utilization across several dynamic sectors, including media, retail, technology, finance, healthcare, and consumer g

Pipeline-centric 52

Pipeline-centric Data Cleanse Data Security Data Pipeline 52

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems