Seattle Data Guy

NOVEMBER 27, 2023

If you’re a data engineer, then you’ve likely at least heard of Airflow. Apache Airflow is one of the most popular open-source workflow orchestration solutions that gets used for data pipelines. This is what spurred me to write the article “Should You Use Airflow” because there are plenty of people who don’t enjoy Airflow or… Read more The post Common Pitfalls in Deploying Airflow for Data Teams appeared first on Seattle Data Guy.

Data Pipeline 130

Data Pipeline Data Engineering Data Engineer Data 130

Tweag

NOVEMBER 27, 2023

Sponsored by Antithesis (distributed systems reliability testing experts), I’ve developed a new library to filter local files in Nix which I’d like to introduce! This post requires some familiarity with Nix and its language. So if you don’t know what Nix is yet, take a look first, it’s pretty neat. In this post we’re going to look at what source filtering is, why it’s useful, why a new library was needed for it, and the basics of the new library.

Building 122

Building Systems IT Project 122

KDnuggets

NOVEMBER 27, 2023

Data analysis is a time-consuming activity. With ChatGPT, we can perform data summary, data preprocessing, data visualization, and many others in a short time.

Data Analysis 122

Data Analysis Data Data Science 122

Confluent

NOVEMBER 27, 2023

The top 7 free online courses, tutorials, get started guides, and examples for the easiest way to learn Apache Kafka.

Kafka 132

Kafka 132

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Knowledge Hut

NOVEMBER 27, 2023

Is your organization active on social media? Whether you work in big business, a charity, the public sector or somewhere else, chances are your organization has or should have social media accounts. That might be YouTube, SlideShare, Pinterest or LinkedIn (or one of many other social networks), and the right channel is going to largely depend on what you want to get out of your engagement with your social media communities.

Media 98

Media Building IT Process 98

KDnuggets

NOVEMBER 27, 2023

Welcome back to Week 4 of KDnuggets’ "Back to Basics" series. This week, we will dive into more advanced topics such as neural networks and deployment.

Data Science 112

Data Science Data 112

Netflix Tech

NOVEMBER 27, 2023

Netflix was thrilled to be the premier sponsor for the 2nd year in a row at the 2023 Conference on Digital Experimentation (CODE@MIT) in Cambridge, MA. The conference features a balanced blend of academic and industry research from some wicked smart folks, and we’re proud to have contributed a number of talks and posters along with a plenary session.

Coding 88

Coding Algorithm Data 88

LinkedIn Engineering

NOVEMBER 27, 2023

Co-Authors: Abhishek Chandak and Ritish Verma We recognize that our 1 billion members and their over 10 billion years’ worth of collective knowledge and insights bring tremendous value to the LinkedIn community. That's why we're committed to enabling our members and customers to safely engage and connect with content. Our Trust & Safety team works diligently to keep harmful content off the platform, allowing members to tap into the real-life, meaningful insights and information shared by the

Machine Learning 87

Machine Learning Data Science Engineering Architecture 87

ArcGIS

NOVEMBER 27, 2023

A suite of ArcGIS Solutions to support common workflows in the stormwater industry.

Utilities 118

Utilities Government Architecture Engineering 118

Monte Carlo

NOVEMBER 27, 2023

When we introduced the concept of data observability four years ago, it resonated with organizations that had unlocked new value…and new problems thanks to the modern data stack. Now, four years later, we are seeing organizations grapple with the tremendous potential…and tremendous challenges posed by generative AI. The answer today is the same as it was then: improve data product reliability by getting full context and visibility into your data systems.

Unstructured Data 59

Unstructured Data Data Pipeline Data Banking 59

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Precisely

NOVEMBER 27, 2023

The COVID-19 pandemic accelerated self-servicing trends in virtually every industry. A Forrester study commissioned by Intercom.com reported that 71% of support leaders and decision-makers credit the pandemic with having an enormous or large impact on how they will address customer support long term. Similarly, Acumen reported that 45% of customers are more likely to use self-service now than they were before the pandemic.

Banking 59

Banking Electronics Accessible Accessibility 59

Knowledge Hut

NOVEMBER 27, 2023

The introduction of cloud computing has replaced the traditional methods of storing and managing resources on-premise. Using the cloud, businesses are able to manage resources effortlessly whilst saving expensive operational costs. As a result, cloud computing skills are significantly increasing and the demand for these designations is high. If you are looking to start a career in the cloud, this is the best time to start.

Cloud Computing 52

Cloud Computing Cloud Google Cloud AWS 52

databricks

NOVEMBER 27, 2023

Building on the momentum of Databricks Assistant, the context-aware AI assistant integrated within Databricks Notebooks, SQL editor, and file editor, and now powering.

SQL 52

SQL Building 52

Knowledge Hut

NOVEMBER 27, 2023

In today's rapidly evolving digital landscape, harnessing the power of cloud computing has become essential for organizations seeking to stay ahead of the curve. A successful professional in this field requires Google cloud skills, namely, expertise in development, operations, and infrastructure, enabling the engineer to streamline and expedite the deployment and administration processes for cloud-based services on GCP efficiently.

Google Cloud 52

Google Cloud Cloud Cloud Computing Pipeline-centric 52

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Confluent

NOVEMBER 27, 2023

See how a derivatives clearing organization unlocks real-time risk management to operate efficiently, at scale.

Management 64

Management 64

Knowledge Hut

NOVEMBER 27, 2023

Transitioning to a career in data science has become increasingly attractive in recent years. The demand for qualified data professionals continues to rise as companies recognize the value of data-driven decision-making. Despite the misconception that a computer science degree is a prerequisite, data science offers a broad field for professionals from various backgrounds.

Data Science 52

Data Science Datasets Machine Learning Portfolio 52

ArcGIS

NOVEMBER 27, 2023

This article is specific to Capella Space SAR satellite data and is part of a blog series on sensor support in ArcGIS Pro.

Data 52

Data Education 52

Towards Data Science

NOVEMBER 27, 2023

A guide for utilizing the cloud with every step of the data science workflow Continue reading on Towards Data Science »

Data Science 52

Data Science Cloud Utilities Data 52

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Snowflake

NOVEMBER 27, 2023

Welcome to Snowflake’s Startup Spotlight, where we learn about awesome companies building businesses on Snowflake. In this edition, find out how Hum is applying the power of AI and large language models (LLMs) to help publishers build stronger customer relationships, and how the mantra of “build what people want” helped their leadership team make the decision to target publishers as their target audience.

Raw Data 101

Raw Data Relational Database Consulting Architecture 101

Cloudera

NOVEMBER 27, 2023

Earlier this month (November 6 through 8, 2023) a few hundred Apache Flink enthusiasts descended upon a Hyatt Regency Lake near Seattle for the annual Flink Forward conference. Cloudera was happy to participate, both as a sponsor of the conference and supporter of the open source community. Flink is, relatively speaking, a newer technology. However, it continues to gain adoption and inspire new development in the core engine as well as supporting technologies.

Kafka 83

Kafka SQL ETL Tools Architecture 83

Snowflake

NOVEMBER 27, 2023

2024 is going to be an important transition year for artificial intelligence. 2023 was the public debut of generative AI and large language models (LLMs), a year of amazement, excitement, occasional panic and, yes, more than a little bit of hype. The year ahead is when businesses begin to make the promise of advanced artificial intelligence real, and we’ll begin seeing the effects on how we work and live.

Government 73

Government Technology Coding Accessibility 73