Mon.Aug 05, 2024

article thumbnail

Time Series Data with NumPy

KDnuggets

Learn how to analyze the time series dataset with the Python package NumPy.

Datasets 142
article thumbnail

A RoCE network for distributed AI training at scale

Engineering at Meta

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 405B. This week at ACM SIGCOMM 2024 in Sydney, Australia, we are sharing details on the network we have built at Meta over the past few years to support our large-scale distributed AI training workload.

article thumbnail

7 AI Portfolio Projects to Boost the Resume

KDnuggets

Get noticed by recruiters and hiring managers by creating and documenting the following AI projects.

Portfolio 139
article thumbnail

Announcing the General Availability of Row and Column Level Security with Databricks Unity Catalog

databricks

Row filters and column masks control data access by filtering rows and masking column values using SQL UDFs in database queries.

SQL 122
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Snowflake Startup Spotlight: BigGeo Puts Geospatial Intelligence on the Map

Snowflake

Welcome to Snowflake’s Startup Spotlight, where we learn about companies building their businesses on Snowflake. In this edition, we talk to Brent Lane, Co-founder and CEO of BigGeo, about the world of geospatial data and learn how BigGeo is turning 15 years of research into advanced technology that knocks down traditional barriers to using rich, complex location-based data throughout an organization.

article thumbnail

5 IT Jobs That Are High in Demand But Don’t Get Enough Recognition

KDnuggets

These IT jobs don’t get enough love and you could be missing out

IT 108

More Trending

article thumbnail

#ClouderaLife Employee Spotlight: Stephanie Han

Cloudera

In this Employee Spotlight, we sat down with Stephanie Han to learn about her tenure at Cloudera, her journey from accounting to leading diversity, equality & inclusion (DEI) programs, and her impressive volunteer work. Meet Stephanie Han Stephanie is a Senior Program Manager in the HR team at Cloudera. She’s been with the company since 2019 and plays a key role in a variety of employee-centric initiatives including Cloudera’s employee volunteering program , talent management program, a

article thumbnail

Beyond the Hype: Is observability just the new name for system monitoring? by Oliver Cronk

Scott Logic

In this episode, I’m joined for a discussion on observability by Scott Rowan, Senior Developer at Scott Logic, and Daniel Gomez Blanco, Principal Engineer at Skyscanner and a member of the Open Telemetry Governance Committee. The conversation explores what observability means in modern distributed software architectures, how it differs from traditional monitoring, and the challenges of implementing observability at scale.

Systems 59
article thumbnail

End-to-end privacy for model training and inference with Concrete ML

KDnuggets

End-to-end privacy for scikit-learn federated training models and encrypted inference using Fully Homomorphic Encryption (FHE)

57
article thumbnail

Sovereign AI, Redpanda vs Apache Kafka, The Future of Data Streaming with Alex Gallego (CEO of Redpanda)

Striim

Prepare to transform your understanding of data and cloud architecture with visionary CEO Alex Gallego of Redpanda. Discover how Alex’s journey from building racing motorcycles and tattoo machines as a child led him to revolutionize stream processing and cloud infrastructure. This episode promises invaluable insights into the shift from batch to real-time data processing, and the practical applications across multiple industries that make this transition not just beneficial but necessary.

Kafka 52
article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Startup Spotlight: BigGeo Puts Geospatial Intelligence on the Map

Snowflake

Welcome to Snowflake’s Startup Spotlight, where we learn about companies building their businesses on Snowflake. In this edition, we talk to Brent Lane, Co-founder and CEO of BigGeo, about the world of geospatial data and learn how BigGeo is turning 15 years of research into advanced technology that knocks down traditional barriers to using rich, complex location-based data throughout an organization.

article thumbnail

Unlock Opportunities and Eliminate Risks with Spatial Analytics

Precisely

Key takeaways: Organizations rely on location-based context to make informed business decisions. Adopting location reports equips business users with critical information that would otherwise require advanced spatial analytics to uncover. APIs make it easy for enterprise developers to build location intelligence into existing applications. A common obstacle to extracting value from the oceans of data stored in business systems is a lack of context.

article thumbnail

PMP for Construction Management: Demand, Certifications

Knowledge Hut

PMP (Project Management Professional) is a professional certification offered by the Project Management Institute (PMI). The Project Management Professional (PMP) credential demonstrates a person's ability to lead and deliver projects successfully. The construction industry is the country's second-largest employer and contributor to the economy. It is also one of the most diverse and unorganized industries, increasing the demand for skilled professionals in this field.