Seattle Data Guy

NOVEMBER 19, 2024

Scraping data from PDFs is a right of passage if you work in data. Someone somewhere always needs help getting invoices parsed, contracts read through, or dozens of other use cases. Most of us will turn to Python and our trusty list of Python libraries and start plugging away. Of course, there are many challenges… Read more The post Challenges You Will Face When Parsing PDFs With Python – How To Parse PDFs With Python appeared first on Seattle Data Guy.

Python 130

Python Data Data Science Data Engineering 130

Simon Späti

NOVEMBER 12, 2024

From Fortune 500 companies processing trillions of security records to innovative startups building interactive data tools, DuckDB is revolutionizing how organizations handle analytical workloads. Building on our exploration of DuckDB’s core capabilities in Part 1 , this guide showcases production implementations and promising experimental applications across five key categories.

Architecture 130

Architecture Project Building Process 130

Christophe Blefari

NOVEMBER 8, 2024

Métro-boulot-dodo ( credits ) It's Data News time. Time really flies on my side, and apart from the bad news from across the Atlantic, all is well on my side. To be honest, I miss you folks. Writing here has been my little thing for the last 3 years and because I haven't been able to get back to my previous frequency since July, I feel empty every Friday.

Data 130

Data Kafka Food Data Preparation 130

Robinhood

NOVEMBER 13, 2024

Robinhood Crypto’s commitment to expanding access and maintaining a safe, easy-to-use platform deepens with the addition of 4 digital assets Today, Robinhood Crypto announced the addition of Solana (SOL), Pepe (PEPE), Cardano (ADA) & XRP (XRP) to its U.S. platform, bringing the total number of cryptocurrencies available for trading to 19. You can see a full list of crypto assets currently available in the U.S. here.

Insurance 140

Insurance Accessibility Accessible Systems 140

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

NOVEMBER 6, 2024

Build an LLM application by easily picking and dropping components and connecting them, such as a vector store, web search, memory, and custom prompt.

Coding 148

Coding Building 148

databricks

NOVEMBER 11, 2024

Databricks Marketplace is an open marketplace for data, analytics, and AI, powered by the open-source Delta Sharing standard. Since the release of Databricks.

Data Analytics 119

Data Analytics Data 119

Simon Späti

NOVEMBER 5, 2024

BI-as-Code and the New Era of GenBI Imagine creating business dashboards by simply describing what you want to see. No more clicking through complex interfaces or writing SQL queries - just have a conversation with AI about your data needs. This is the promise of Generative Business Intelligence (GenBI). At its core, GenBI delivers an unreasonably effective human interface , where we iterate quickly, based on BI-as-Code.

BI 130

BI Coding Business Intelligence SQL 130

Monte Carlo

NOVEMBER 12, 2024

A data engineering architecture is the structural framework that determines how data flows through an organization – from collection and storage to processing and analysis. It’s the big blueprint we data engineers follow in order to transform raw data into valuable insights. Before building your own data architecture from scratch though, why not steal – er, learn from – what industry leaders have already figured out?

Architecture 96

Architecture Data Engineering Data Engineer Engineering 96

Netflix Tech

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction. This counting service, built on top of the TimeSeries Abstraction, enables distributed counting at scale while maintaining similar low latency performance.

Datasets 89

Datasets Computer Science Systems Kafka 89

KDnuggets

NOVEMBER 15, 2024

Turn any document into a conversation-ready AI tool with AnythingLLM — a versatile, open-source platform for building a secure, private assistant.

Building 126

Building 126

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

databricks

NOVEMBER 20, 2024

We are thrilled to unveil the finalists for the Databricks Generative AI Startup Challenge , a competition designed to spotlight innovative early-stage startups.

Designing 99

Designing 99

Seattle Data Guy

NOVEMBER 12, 2024

A key responsibility for any data team is to understand the core metrics driving their business. Starting from the top, these metrics often include figures like gross revenue and expenses. However, these high-level metrics can feel too far removed and abstract from the actual business. Many companies, therefore, break down these top-line metrics into more… Read more The post How Data Teams Drive Business Success by Understanding Core Metrics appeared first on Seattle Data Guy.

Data 130

Data Data Science 130

Cloudera

NOVEMBER 1, 2024

Over the last few months, Cloudera has been traversing the globe hosting our EVOLVE24 event series. It has been a time full of excitement, innovative ideas, and connection with our partners and customers. It also provided a moment for us to launch an important initiative for Cloudera: our Women Leaders in Technology (WLIT) initiative. WLIT is a global initiative developed to create a forum wherein women and allies in tech leadership roles can connect with and demonstrate to women and girls tha

Technology 91

Technology Recruitment Banking AWS 91

ArcGIS

NOVEMBER 4, 2024

An overview of all the enhancements and improves with ArcGIS Data Interoperability with the latest release of ArcGIS Pro at version 3.4.

Data 103

Data Metadata 103

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Snowflake

NOVEMBER 4, 2024

You’ve heard about Snowflake’s new capabilities, our fresh products and innovations that help bring AI and apps to life. Now, it’s time to BUILD. Join us for BUILD 2024, a three-day global virtual conference taking place Nov. 12-15, to hear major Snowflake product announcements firsthand and to learn how to build with our latest innovations through dozens of technical sessions and hands-on labs.

Unstructured Data 86

Unstructured Data Python Data Pipeline Machine Learning 86

KDnuggets

NOVEMBER 13, 2024

Improve your Python data cleaning by fixing invalid entries, converting types, encoding variables, handling outliers, selecting features, scaling, and filling missing values.

Python 117

Python Data 117

databricks

NOVEMBER 5, 2024

We’re excited to announce that materialized views (MVs) and streaming tables (STs) are now Generally Available in Databricks SQL on AWS and Azure.

SQL 114

SQL AWS Engineering 114

Seattle Data Guy

NOVEMBER 8, 2024

Recently, I’ve encountered a few projects that used AWS DMS, which is almost like an ELT solution. Whether it was moving data from a local database instance to S3 or some other data storage layer. It was interesting to see AWS DMS used in this manner. But it’s not what DMS was built for. As… Read more The post What Is AWS DMS And Why You Shouldn’t Use It As An ELT appeared first on Seattle Data Guy.

AWS 130

AWS IT Data Storage Database 130

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Cloudera

NOVEMBER 13, 2024

We are excited to announce the acquisition of Octopai , a leading data lineage and catalog platform that provides data discovery and governance for enterprises to enhance their data-driven decision making. Cloudera’s mission since its inception has been to empower organizations to transform all their data to deliver trusted, valuable, and predictive insights.

Metadata 82

Metadata Management Data Governance Government 82

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. A long-term approach to your data strategy is key to success as business environments and technologies continue to evolve. The rapid pace of technological change has made data-driven initiatives more crucial than ever within modern business strategies.

Data Analytics 72

Data Analytics Data Governance Data Integration Government 72

Snowflake

NOVEMBER 11, 2024

It’s easy these days for an organization’s data infrastructure to begin looking like a maze, with an accumulation of point solutions here and there. While some businesses find ways to stitch together many tools with complex pipelines, wouldn’t it be better if you could remove some of the steps? What if you could streamline your efforts while still building an architecture that best fits your business and technology needs?

Data Architecture 77

Data Architecture Architecture Data Lake Kafka 77

KDnuggets

NOVEMBER 12, 2024

In this tutorial, we’ll explore when and how SQL functionality can be integrated within the Pandas framework, as well as its limitations.

SQL 128

SQL Data Analysis Data IT 128

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project

databricks

NOVEMBER 12, 2024

Monolithic to Modular The proof of concept (POC) of any new technology often starts with large, monolithic units that are difficult to characterize.

Systems 105

Systems Engineering Technology Data 105

Seattle Data Guy

NOVEMBER 5, 2024

Leading data teams can be challenging. You’ve got management and non-technical teams constantly reaching out with ad-hoc data requests; you’re likely trying to figure out what tools will work best and not blow the bank. Not to mention, you’ve got to bridge the gap between business and technology. All while trying to grow your data… Read more The post 9 Must-Watch Videos for Aspiring Data Leaders: Bridging Tech and Business for Data Team Success appeared first on Seattle D

Banking 130

Banking Data Technology Management 130

Cloudera

NOVEMBER 15, 2024

Today, cyber defenders face an unprecedented set of challenges as they work to secure and protect their organizations. In fact, according to the Identity Theft Resource Center (ITRC) Annual Data Breach Report , there were 2,365 cyber attacks in 2023 with more than 300 million victims, and a 72% increase in data breaches since 2021. The constant barrage of increasingly sophisticated cyberattacks has left many professionals feeling overwhelmed and burned out.

Metadata 77

Metadata Unstructured Data Data Lake Government 77

DataKitchen

NOVEMBER 5, 2024

The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams. It is a layered approach to managing and transforming data. The Medallion architecture is a design pattern that helps data teams organize data processing and storage into three distinct layers, often called Bronze, Silver, and Gold.

Architecture 79

Architecture Raw Data Pipeline-centric Data Ingestion 79

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.

Government

Engineering at Meta

NOVEMBER 19, 2024

AI plays a fundamental role in creating valuable connections between people and advertisers within Meta’s family of apps. Meta’s ad recommendation engine, powered by deep learning recommendation models (DLRMs) , has been instrumental in delivering personalized ads to people. Key to this success was incorporating thousands of human-engineered signals or features in the DLRM-based recommendation system.

Architecture 66

Architecture Engineering Deep Learning Systems 66

KDnuggets

NOVEMBER 20, 2024

Let's take a look at how we can perform NER using that Swiss army knife of NLP and LLM libraries, Hugging Face's Transformers.

116

116

databricks

NOVEMBER 1, 2024

We are thrilled to announce the General Availability of a Python step-through debugger for Databricks Notebooks and Files. This highly requested feature allows.

Python 105

Python 105

Snowflake

NOVEMBER 12, 2024

Today we're thrilled to announce the general availability of Hybrid Tables in all AWS commercial regions (with a few exceptions ). As part of Snowflake Unistore , Hybrid Tables unify both transactional and analytical workloads on a single database to simplify architectures as well as governance and security. Since launching the public preview of Hybrid Tables this year, we have seen adoption across industries from customers such as Siemens , Panther, Mutual of Omaha, PowerSchool , MarketWise and

Food 71

Food Metadata Education AWS 71

Advertisement

Entity Resolution Sometimes referred to as data matching or fuzzy matching, entity resolution, is critical for data quality, analytics, graph visualization and AI. Learn what entity resolution is, why it matters, how it works and its benefits. Advanced entity resolution using AI is crucial because it efficiently and easily solves many of today’s data quality and analytics problems.

IT