Confessions of a Data Guy
OCTOBER 7, 2024
This is an interesting one indeed, it’s one that teases and puzzles the brain to no end. Has the Data Warehouse finally died, has that unruly upstart the Lake House finally taken its place atop the seething mass of data we call home? Can we say that after all these decades the Data Warehouse Toolkit […] The post The Death of the Data Warehouse, replaced by the Lake House.
The Pragmatic Engineer
OCTOBER 10, 2024
Automattic, creator of Wordpress, is being sued by one of the largest WordPress hosting providers. The conflict fits into a trend of billion-dollar companies struggling to effectively monetize open source, and are changing tactics to limit their competition and increase their revenue. This article was originally published a week ago, on 3 October 2024, in The Pragmatic Engineer.
Analytics Vidhya
OCTOBER 7, 2024
Introduction Today, data systems evolve quickly, demanding efficient monitoring and response. Real-time change detection is essential to keeping systems stable, preventing failures, and ensuring business continuity. Microsoft’s open-source tool, Drasi, addresses this need by effortlessly detecting, monitoring, and responding to data changes across platforms, including relational and graph databases.
KDnuggets
OCTOBER 8, 2024
Are you a data science beginner looking to build your portfolio? Start working on these projects today.
Advertisement
Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.
databricks
OCTOBER 8, 2024
Summary Databricks Apps, a new way to build and deploy internal data and AI applications, is now available in Public Preview on AWS.
Yelp Engineering
OCTOBER 6, 2024
The Yelp Reservations service (yelp_res) is the service that powers reservations on Yelp. It was acquired along with Seatme in 2013, and is a Django service and webapp. It powers the reservation backend and logic for Yelp Guest Manager, our iPad app for restaurants, and handles diner and partner flows that create reservations. Along with that, it serves a web UI and backend API for our Yelp Reservations app, which has been superseded by Yelp Guest Manager but is still used by many of our restaur
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
KDnuggets
OCTOBER 11, 2024
Dive into this emerging and powerful LLM-based AI tool for enhancing your business, creative, or daily processes through well-managed conversations.
databricks
OCTOBER 8, 2024
Retrieval Augmented Generation (RAG) is the top use case for Databricks customers who want to customize AI workflows on their own data. The.
Robinhood
OCTOBER 10, 2024
When Robinhood was founded, we set out to build a platform that gives everyone access to the financial markets. Over the last decade, we’ve disrupted and changed the industry for the better, becoming the first U.S. retail broker to offer commission-free trading, and saving investors billions in the process. In recent years, we’ve expanded our offering, ushering in a number of new cutting-edge products and services that help everyone – regardless of income – trade, invest, and earn.
ArcGIS
OCTOBER 8, 2024
The response digital twin to assist disaster management of North Rhine-Westphalia illustrates how to create and maintain 3D mesh data.
Speaker: Tamara Fingerlin, Developer Advocate
In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!
KDnuggets
OCTOBER 7, 2024
Read this overview of prompting techniques, challenges, and best practices to help you master this essential AI skill.
databricks
OCTOBER 8, 2024
We consistently hear from our customers that one of the headwinds to transitioning Generative AI applications from pilot to production is the accuracy.
Data Engineering Weekly
OCTOBER 11, 2024
The data world is abuzz with speculation about the future of data engineering and the successor to the celebrated modern data stack. While the modern data stack has undeniably revolutionized data management with its cloud-native approach, its complexities and limitations are becoming increasingly apparent. As we grapple with these, another seismic shift is upon us—the rise of Large Language Models (LLMs).
Yelp Engineering
OCTOBER 7, 2024
In 2019, Yelp’s Core Android team led an effort to boost navigation performance in Yelp’s Consumer app. We switched from building screens with multiple separate activities to using fragments inside a single activity. In this blog post, we’ll cover our solution, how we approached the migration and share learnings from along the way as well as performance wins.
Advertisement
Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.
KDnuggets
OCTOBER 9, 2024
Acquire a transversal understanding of high-relevance AI jargon in the time it takes to drink a cup of coffee.
databricks
OCTOBER 10, 2024
Today, we are excited to announce the general availability of Databricks Assistant Autocomplete on all cloud platforms. Assistant Autocomplete provides personalized AI-powered code.
Cloudera
OCTOBER 10, 2024
The open data lakehouse is quickly becoming the standard architecture for unified multifunction analytics on large volumes of data. It combines the flexibility and scalability of data lake storage with the data analytics, data governance, and data management functionality of the data warehouse. Open table formats are a key component of this architecture, as they provide many of the capabilities of traditional data warehousing directly on data lake storage, and Apache Iceberg is quickly becoming
Netflix Tech
OCTOBER 8, 2024
Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital. In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architectu
Advertisement
Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?
KDnuggets
OCTOBER 8, 2024
Tired of fixing the same deployment issues? Learn how Docker can keep your ML models running smoothly, every time.
databricks
OCTOBER 7, 2024
We are announcing the General Availability of Provider Usage Analytics for Databricks Marketplace providers. This feature lets you analyze lead generation and product.
Snowflake
OCTOBER 7, 2024
When scaling data science and ML workloads, organizations frequently encounter challenges in building large, robust production ML pipelines. Common issues include redundant efforts between development and production teams, as well as inconsistencies between the features used in training and those in the serving stack, which can lead to decreased performance.
Cloudera
OCTOBER 8, 2024
We are thrilled to announce the general availability of the Cloudera AI Inference service, powered by NVIDIA NIM microservices , part of the NVIDIA AI Enterprise platform, to accelerate generative AI deployments for enterprises. This service supports a range of optimized AI models, enabling seamless and scalable AI inference. Background The generative AI landscape is evolving at a rapid pace, marked by explosive growth and widespread adoption across industries.
Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali
As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.
KDnuggets
OCTOBER 7, 2024
Combining LLM reasoning for text-based models in Scikit-Learn.
databricks
OCTOBER 9, 2024
With the pace of modern business and the competitive need for more and more data, organizations now correctly ask whether their data management.
Confluent
OCTOBER 11, 2024
Learn how to leverage event design to make eventual bad data in your event streams easier to repair, and also what to do when you have a contaminated stream.
Pinterest Engineering
OCTOBER 11, 2024
Alex Wang; Software Engineer I | Lei Pan; Software Engineer II | Raymond Lee; Senior Software Engineer | Saurabh Vishwas Joshi; Senior Staff Software Engineer | Chia-Wei Chen; Senior Software Engineer | Introduction In Part 1 of our blog series, we discussed why we chose to use Ray(™) as a last mile data processing framework and how it enabled us to solve critical business problems.
Speaker: Nikhil Joshi, Founder & President of Snic Solutions
Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.
KDnuggets
OCTOBER 10, 2024
NotebookLM makes it easy to create study guides from YouTube videos by using AI to summarize and organize key points. Just upload the video link, and the tool helps you turn the content into a structured guide.
databricks
OCTOBER 9, 2024
In industries like finance and retail, vast data is leveraged to generate billions in profits. Yet, in healthcare, the struggle to access critical.
ThoughtSpot
OCTOBER 8, 2024
After being recognized by Gartner as the leading generative analytics experience for augmented analytics , ThoughtSpot’s SpotIQ just got an upgrade. As an integral part of ThoughtSpot’s core platform for nearly seven years , SpotIQ has unlocked the value of billions of rows of data for hundreds of customers. Even more inspiring are the customer testimonials highlighting how SpotIQ empowers business users to perform complex analytics and analyze key metrics—even on the go.
Data Engineering Weekly
OCTOBER 6, 2024
PyTorch: PyTorch Conference 2024 Recap - On Fire 🔥 PyTorch plays a significant role in the latest development of AI in the industry. The article nicely summarizes the key takeaways from the conference. All the talks are now available on YouTube. If you are new to PyTorch and want to learn, the tutorial from freecodecamp is the best. [link] Medium: Learnings from optimising 22 of our most expensive Snowflake pipelines A blog about real-world learning is always a delight to read.
Advertisement
Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.
Expert insights. Personalized for you.
113 
Let's personalize your content