Precisely

NOVEMBER 20, 2023

AI transforms how we interact with technology, make decisions, and solve complex problems. It has been at the heart of many innovations over the past two years, powering everything from the chatbots that enhance our customer experiences to the predictive analytics engines that help us make financial decisions. What defines a successful AI initiative, and how can your organization ensure that your investments and hard work deliver maximum value for your organization?

Raw Data 121

Raw Data Insurance Data Portfolio 121

Start Data Engineering

NOVEMBER 14, 2023

1. Introduction 2. What is an Open Table Format (OTF) 3. Why use an Open Table Format (OTF) 3.0. Setup 3.1. Evolve data and partition schema without reprocessing 3.2. See previous point-in-time table state, aka time travel 3.3. Git like branches & tags for your tables 3.4. Handle multiple reads & writes concurrently 4. Conclusion 5. Further reading 6.

Data 323

Data 323

The Pragmatic Engineer

NOVEMBER 21, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover thee out of nine topics from today’s subscriber-only issue: The Past and Future of Modern Backend Practices.

Engineering 297

Engineering Bytes Cloud Computing AWS 297

Analytics Vidhya

NOVEMBER 8, 2023

Introduction Imagine yourself in command of a sizable cargo ship sailing through hazardous waters. It is your responsibility to deliver precious cargo to its destination safely. Determine success by the precision of your charts, the equipment’s dependability, and your crew’s expertise. A single mistake, glitch, or slip-up could endanger the trip. In the data-driven world […] The post Monitoring Data Quality for Your Big Data Pipelines Made Easy appeared first on Analytics Vidhya.

Big Data 246

Big Data Data Pipeline Data IT 246

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

NOVEMBER 29, 2023

Probability is one of the foundational elements of computer science. Some bootcamps will skim over the topic, however, it is integral to your computer science knowledge.

Computer Science 150

Computer Science IT Data Science Data 150

Zalando Engineering

NOVEMBER 8, 2023

Introduction This blog post describes a recent contribution from Zalando to the Postgres JDBC driver to address a long-standing issue with the driver’s integration with Postgres’ logical replication that resulted in runaway Write-Ahead Log (WAL) growth. We will describe the issue, how it affected us at Zalando, and detail the fix made upstream in the JDBC driver that fixes the issue for Debezium and all other clients of the Postgres JDBC driver.

PostgreSQL 138

PostgreSQL Java Database Bytes 138

Confluent

NOVEMBER 28, 2023

Learn how to write code that produces messages via librdkafka, how it will behave during error situations, and how your application should detect and respond to them.

Coding 131

Coding IT Kafka 131

The Pragmatic Engineer

NOVEMBER 9, 2023

The below topic was sent out to full subscribers of The Pragmatic Engineer , three weeks ago, in The Pulse #66. I have received several messages from people asking if they can pay to “unlock” this information for others, given how vital it is for software engineers. It is vital, and so I’m sharing this with all readers, without a paywall.

Software Engineering 222

Software Engineering Software Engineer Engineering Coding 222

Analytics Vidhya

NOVEMBER 26, 2023

In this Leading with Data episode, explore the analytics landscape with Dr. Swati Jain, a seasoned leader boasting over two decades of experience. From her unforeseen foray into analytics to steering EXL Analytics’ India business, Dr. Jain imparts invaluable insights into the ever-evolving world of data science. Read on to know more about her career, […] The post Unlocking the Power of Analytics with Dr.

Data Science 214

Data Science Data Analysis Data Data Engineering 214

KDnuggets

NOVEMBER 7, 2023

To solve the conundrum of ensuring the quality of AI models in production — especially given the emergence of LLMs — we are thrilled to announce the official launch of Giskard, the premier open-source AI quality management system.

Management 145

Management Systems 145

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Engineering at Meta

NOVEMBER 8, 2023

New optional features in WhatsApp have helped make calling on WhatsApp more secure. “Silence Unknown Callers” is a new setting on WhatsApp that not only quiets annoying calls but also blocks sophisticated cyber attacks. “Protect IP Address in Calls” is a new setting on WhatsApp that helps hide your location from other parties on the call. Privacy and security are at the core of WhatsApp.

Metadata 127

Metadata Process Designing Data Process 127

databricks

NOVEMBER 6, 2023

We are excited to announce that we have completed our acquisition of Arcion, a leading provider for real-time data replication technologies. Arcion’s capabilities w.

Data 138

Data Technology 138

Tweag

NOVEMBER 27, 2023

Sponsored by Antithesis (distributed systems reliability testing experts), I’ve developed a new library to filter local files in Nix which I’d like to introduce! This post requires some familiarity with Nix and its language. So if you don’t know what Nix is yet, take a look first, it’s pretty neat. In this post we’re going to look at what source filtering is, why it’s useful, why a new library was needed for it, and the basics of the new library.

Building 122

Building Systems IT Project 122

Confluent

NOVEMBER 3, 2023

Learn how AI-powered customer intelligence platform Dialpad modernized its data infrastructure and improved customer satisfaction rates with Confluent and Startree.

IT 127

IT Data 127

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Precisely

NOVEMBER 14, 2023

When speaking to organizations about data integrity , and the key role that both data governance and location intelligence play in making more confident business decisions, I keep hearing the following statements: “For any organization, data governance is not just a nice-to-have! “ “Everyone knows that 80% of data contains location information. Why are you still telling us this, Monica?

Data Governance 119

Data Governance Government Metadata Retail 119

KDnuggets

NOVEMBER 1, 2023

This list of machine learning algorithms is a good place to start your journey as a data scientist. You should be able to identify the most common models and use them in the right applications.

Machine Learning 144

Machine Learning Algorithm Data 144

ArcGIS

NOVEMBER 7, 2023

From oriented imagery to engaging thematic map series, there is something for everyone in this release of ArcGIS Pro 3.2.

143

143

databricks

NOVEMBER 15, 2023

The observation that "software is eating the world" has shaped the modern tech industry. Today, software is ubiquitous in our lives, from the.

Data 144

Data 144

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Tweag

NOVEMBER 22, 2023

This article aims to introduce and explore the practice of splitting debug symbols away from C/C++ build artifacts to save space and time when building large codebases. Note that we want to retain access to the debug symbols if and when they are needed at a later date, hence we don’t want to merely remove (aka strip ) the debug symbols. 1 This exploration is largely inspired and based on what I have learned in various places around the web, most notably: Improving C++ Builds with Split DWARF, by

Bytes 122

Bytes Coding Building Project 122

Snowflake

NOVEMBER 15, 2023

BUILD 2023 is where AI gets real. Join our two-day virtual global conference and learn how to build with the app dev innovations you heard about at Snowflake Summit and Snowday. We have more demos and hands-on virtual labs than ever before—and you won’t find a bunch of slideware here. The focus is on tools and capabilities that are generally available or in public and private preview, so you can leave BUILD and put your new skills into action immediately.

Building 112

Building Accessibility Accessible IT 112

Cloudera

NOVEMBER 1, 2023

Elevate your AI applications with our latest applied ML prototype At Cloudera, we continuously strive to empower organizations to unlock the full potential of their data, catalyzing innovation and driving actionable insights. And so we are thrilled to introduce our latest applied ML prototype (AMP) — a large language model (LLM) chatbot customized with website data using Meta’s Llama2 LLM and Pinecone’s vector database.

Machine Learning 110

Machine Learning Data Ingestion Database Architecture 110

KDnuggets

NOVEMBER 21, 2023

Master algorithms, including deep learning like LSTMs, GRUs, RNNs, and Generative AI & LLMs such as ChatGPT, with Packt's 50 Algorithms Every Programmer Should Know.

Algorithm 144

Algorithm Computer Science Machine Learning Deep Learning 144

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

ArcGIS

NOVEMBER 14, 2023

Here's everything new in ArcGIS Pro 3.2 from the Geodatabase Team. Schema Reports, 64-bit OIDs, Big Integer fields, new date fields, etc.

Data Management 126

Data Management Management Data 126

databricks

NOVEMBER 28, 2023

Defining what a data culture is can vary by organization. A data culture is the shared values, attitudes, and behaviors that enable organizations.

Building 131

Building Data 131

Tweag

NOVEMBER 15, 2023

tl;dr: We’re pleased to announce the beta release of Organist , a tool designed to ease the definition of reliable and low-friction development environments and workflows, building on the combined strengths of Nix and Nickel. A mess of cables and knobs I used to play piano as a kid. As a teenager, I became frustrated by the limitations of the instrument and started getting into synthesizers.

Management 120

Management Python Programming Language Project 120

Pinterest Engineering

NOVEMBER 7, 2023

Jeff Xiang | Software Engineer, Logging Platform Vahid Hashemian | Software Engineer, Logging Platform Jesus Zuniga | Software Engineer, Logging Platform At Pinterest, data is ingested and transported at petabyte scale every day, bringing inspiration for our users to create a life they love. A central component of data ingestion infrastructure at Pinterest is our PubSub stack, and the Logging Platform team currently runs deployments of Apache Kafka and MemQ.

Kafka 110

Kafka Java Software Engineer Software Engineering 110

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.

Government

Snowflake

NOVEMBER 1, 2023

Snowflake has invested heavily in extending the Data Cloud to AI/ML workloads, starting in 2021 with the introduction of Snowpark , the set of libraries and runtimes in Snowflake that securely deploy and process Python and other popular programming languages. Since then, we’ve significantly opened up the ways Snowflake’s platform, including its elastic compute engine can be used to accelerate the path from AI/ML development to production.

Building 108

Building Python SQL Programming Language 108

KDnuggets

NOVEMBER 6, 2023

From November 6 (07:00 PST) to November 20 (07:00 PST), enjoy free unlimited access to 365 Data Science's comprehensive curriculum, interactive courses, practical data projects, and earn industry-recognized certificates—all at no charge.

Accessibility 140

Accessibility Accessible Data Science Certification 140

ArcGIS

NOVEMBER 15, 2023

Prepare your environment to run out-of-the-box deep learning geoprocessing tools in ArcGIS Pro. Machine learning is more accessible than ever with pre-trained models enabling you to extract data from your imagery.

Deep Learning 108

Deep Learning Machine Learning Accessible Accessibility 108

Netflix Tech

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. Many metrics in Netflix’s financial reports are powered and reconciled with efforts from our team!

Data Engineering 107

Data Engineering Data Engineer Engineering Metadata 107

Advertisement

Entity Resolution Sometimes referred to as data matching or fuzzy matching, entity resolution, is critical for data quality, analytics, graph visualization and AI. Learn what entity resolution is, why it matters, how it works and its benefits. Advanced entity resolution using AI is crucial because it efficiently and easily solves many of today’s data quality and analytics problems.

IT