KDnuggets

OCTOBER 10, 2023

Looking to understand the semantic layer and how it can improve your data stack? This GigaOm Sonor report on Semantic Layers can help you delve deeper.

Data 84

Data IT 84

The Pragmatic Engineer

OCTOBER 10, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover three out of eight topics from today’s deepdive into tech scaleup Chronosphere. To get full issues twice a week, subscribe here.

Software Engineer 263

Software Engineer Software Engineering Architecture Media 263

Data Engineering Podcast

OCTOBER 8, 2023

Summary The insurance industry is notoriously opaque and hard to navigate. Max Cho found that fact frustrating enough that he decided to build a business of making policy selection more navigable. In this episode he shares his journey of data collection and analysis and the challenges of automating an intentionally manual industry. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Insurance 162

Insurance BI SQL Machine Learning 162

Marc Lamberti

OCTOBER 11, 2023

Do you wonder how to use the DockerOperator in Airflow to kick off a docker image? Or how to run a task without creating dependency conflicts? In this tutorial, you will discover everything you need about the DockerOperator with practical examples. If you’re new to Airflow, I’ve created a course you can check out here. Ready? Let’s go!

AWS 130

AWS Python Hadoop SQL 130

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Waitingforcode

OCTOBER 10, 2023

If you have some experience with RDBMS, who doesn't btw, you have probably run a VACUUM command to reclaim the storage space occupied by deleted or obsolete rows. If you're now working with Delta Lake, you can do the same!

130

130

Christophe Blefari

OCTOBER 9, 2023

( credits ) Hey, I'm a bit late once again. I hope this newsletter edition finds you well. This is almost a raw edition, I had quite a big amount of links, I hope you will like this selection. Gen AI 🤖 OpenAI’s plan to build the "iPhone of artificial intelligence" — Obviously this is one of the main struggle for OpenAI.

Python 130

Python Data Database Java 130

KDnuggets

OCTOBER 12, 2023

Ready to take your machine learning skills to new heights? Dive into the world of Metaflow with us and elevate your expertise with Uplimit's Full-Stack Machine Learning with Metaflow course!

Machine Learning 136

Machine Learning 136

Jesse Anderson

OCTOBER 12, 2023

Unapologetically Technical is finally back with a new episode! In this episode of Unapologetically Technical, I had the pleasure of interviewing Neil Avery from Liquidlabs. We discussed his experiences creating grid computing systems at major banks like Royal Bank of Scotland and Deutchebank, as well as his journey to founding a startup called Logscape and working as a consultant at Excellian.

Banking 100

Banking Consulting Kafka Systems 100

ThoughtSpot

OCTOBER 9, 2023

When using data to make impactful business decisions, certain doubts may start to arise, like “What does this column exactly mean?” or “Can I trust this data source I want to use?” Questions like these speak to a larger need for increased data literacy and trust in data. ThoughtSpot continually invests in this area, giving users the confidence to build the correct Answers needed for their analysis—and ensuring they can trust the data they are shown.

Metadata 105

Metadata Data Government Data Governance 105

databricks

OCTOBER 10, 2023

We’re excited to announce that Meta AI’s Llama 2 foundation chat models are available in the Databricks Marketplace for you to fine-tune and dep.

Machine Learning 130

Machine Learning Data Science Data 130

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

OCTOBER 12, 2023

SQL is the essential data science language due to its universal database accessibility, efficient data cleaning capabilities, seamless integration with other languages, and requirement for most data science jobs.

Data Science 136

Data Science SQL Database Data 136

Snowflake

OCTOBER 9, 2023

Easily collect and store digital events directly to create a complete composable customer data platform (CDP) Marketers are increasingly leveraging the Snowflake Data Cloud as the foundation for all of their customer data analytics and activation. Marketing teams are creating composable customer data platforms (CDPs) on the Data Cloud to build a 360-degree view of each customer.

Cloud 99

Cloud Building SQL Data 99

LinkedIn Engineering

OCTOBER 13, 2023

Co-Authors: Chaitali Parmar , Eric Stoll , and Natasha Michel At Linkedin, one of the Information Security team's core commitments is to enable an environment of trusted and secure products, platforms, and infrastructure for our employees, members, and customers. The Infosec Governance, Risk and Compliance (GRC) and Third Party Security (TPS) teams are responsible for documenting security policy and monitoring in-house and third party risk and control environments to assure compliance and a heal

Management 98

Management IT Aggregated Data Programming 98

databricks

OCTOBER 9, 2023

We’re excited to announce that Databricks has obtained the International Standards Organization (ISO) 27701 certification as a data processor. This certification reflects our c.

Certification 97

Certification Data 97

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

OCTOBER 11, 2023

This week: What three data science projects should you choose to guarantee you get the job? • A 7 step guide to help you go from the fundamentals of machine learning and Python to Transformers, recent advances in NLP, and beyond.

Data Science 129

Data Science Project Machine Learning Python 129

Confluent

OCTOBER 12, 2023

With Confluent Cloud, Loggi migrated to an event-driven architecture, powering real-time analytics, boosting productivity, and cutting costs.

Architecture 98

Architecture Cloud 98

Snowflake

OCTOBER 12, 2023

In the age of climate consciousness, industries worldwide are grappling with the urgent need to reduce their carbon footprints. One industry that has come under increased scrutiny is telecommunications, where Scope 3 emissions , or the indirect emissions that occur in a company’s value chain that the company has no direct control over, alone account for a staggering 85% of a typical telecom company’s carbon footprint.

Telecommunication 82

Telecommunication Utilities Consulting Cloud 82

databricks

OCTOBER 13, 2023

This blog was written in collaboration with David Roberts (Analytics Engineering Manager), Kevin P. Buchan Jr (Assistant Vice President, Analytics), and Yubin Park.

Engineering 99

Engineering Management 99

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

KDnuggets

OCTOBER 13, 2023

A new deep learning framework built entirely in Rust that aims to balance flexibility, performance, and ease of use for researchers, ML engineers, and developers.

Deep Learning 131

Deep Learning Engineering Machine Learning 131

Confluent

OCTOBER 11, 2023

Apache Kafka 3.6 brings Tiered Storage Early Access, migrating clusters from ZooKeeper to KRaft with no downtime, a grace period for stream-table joins, and more!

Kafka 90

Kafka Accessible Accessibility 90

Precisely

OCTOBER 9, 2023

Telecom providers invest heavily in infrastructure, so it’s vital that they optimize those investments by using an intelligent planning process. That means making data-driven decisions based on rich, contextual, location-based data. Is your company making the right investments in infrastructure? That depends on the answers to three questions: Are you building in the right place?

Telecommunication 69

Telecommunication Raw Data Portfolio Data Validation 69

databricks

OCTOBER 11, 2023

We are delighted to announce that Databricks Asset Bundles are now in public preview. Bundles, for short, facilitate the adoption of software engineering.

Software Engineer 104

Software Engineer Software Engineering Engineering 104

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

KDnuggets

OCTOBER 12, 2023

This article talks about several best practices for writing ETLs for building training datasets. It delves into several software engineering techniques and patterns applied to ML.

Building 119

Building Software Engineer Software Engineering Datasets 119

Confluent

OCTOBER 10, 2023

Learn how data streaming enables you to accurately predict future customer demands while delivering the right products in the right quantities to satisfy customer demand without creating a surplus.

Data 72

Data 72

Towards Data Science

OCTOBER 12, 2023

Construction engineer investigating his work — Stable diffusion Introduction In our previous publication, From Data Engineering to Prompt Engineering , we demonstrated how to utilize ChatGPT to solve data preparation tasks. Apart from the good feedback we have received, one critical point has been raised: Prompt engineering may help with simple tasks, but is it really useful in a more challenging environment?

Data Integration 68

Data Integration Systems Engineering Datasets 68

databricks

OCTOBER 9, 2023

Written in partnership with Shell. The energy industry is all about physical assets – from terminals, ships and pipelines to refineries and wind f.

Data Analytics 93

Data Analytics Data Manufacturing 93

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

Business Intelligence

KDnuggets

OCTOBER 11, 2023

RNN, Transformers, and BERT are popular NLP techniques with tradeoffs in sequence modeling, parallelization, and pre-training for downstream tasks.

Process 134

Process 134

Confluent

OCTOBER 9, 2023

Learn how data streaming and artificial intelligence enables you to project your brand’s reputation with real-time social media monitoring.

Media 80

Media Data Project 80

Monte Carlo

OCTOBER 11, 2023

Today, I’m thrilled to announce that Eli Collins, VP of Product at Google DeepMind, will join us on stage as our surprise keynote speaker at IMPACT: The Data Observability Summit ! Alongside Billy Beane ( yes, that Billy Beane ), Annie Duke, author of one of my favorite books, Thinking in Bets , and Nga Phan, SVP of Product at Salesforce AI, Eli will round out our slate of data and AI keynotes for the conference.

Google Cloud 64

Google Cloud Portfolio Deep Learning Data 64

databricks

OCTOBER 13, 2023

Today, we are excited to announce the general availability of the Databricks SQL Statement Execution API on AWS and Azure, with support for.

SQL 89

SQL AWS 89

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.

Government