Snowflake

MAY 16, 2024

The event-driven architecture converts events to Snowflake’s relational tables, enabling rapid, accurate, and secure data delivery for the most crucial government programs — ultimately benefiting more people, more smoothly. The work we do together is truly meaningful. ”

Education 102

Education Accessibility Accessible Recruitment 102

Data Engineering Podcast

FEBRUARY 18, 2024

Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Snowflake

APRIL 2, 2025

Manage secure multi-engine access with Snowflakes Open Catalog , a fully managed service for Polaris that preserves the option to self-manage by maintaining role-based access controls (RBAC), namespaces and definitions intact, regardless of where the catalog is hosted nearly eliminating migration complexity.

Data Lake 88

Data Lake Cloud Storage Metadata Data Warehouse 88

The Pragmatic Engineer

OCTOBER 10, 2024

Wordpress.org – which has a complex, intertwined setup with Automattic, and was also cofounded by Matt Mullenweg –  bans  WP Engine from accessing its plugin repository and updates infrastructure. 25 Sep: Block. This penalizes WP Engine customers. 27 Sep: Unblock.  Wordpress.org 

Consulting 330

Consulting AWS Engineering Software Engineer 330

Engineering at Meta

FEBRUARY 13, 2025

We also celebrated the security research done by our bug bounty community as part of our annual bug bounty summit and many other industry events. Noteworthy contributions over the years include Philippes groundbreaking research on Instagram access token leak , video capture limit bypass on Ray-Ban stories , and more.

Programming 109

Programming Designing Accessible Accessibility 109

The Pragmatic Engineer

APRIL 11, 2024

Confirming this suspicion is Fabrick’s status page that says Fabrick’s tech staff are involved: “We would like to inform you that the event is currently still ongoing, continuous monitoring is in place, and any slowdowns are affecting only the services provided jointly with the Sella group.

Banking 255

Banking Utilities Database Engineering 255

Snowflake

NOVEMBER 26, 2024

Processing some 90,000 tables per day, the team oversees the ingestion of more than 100 terabytes of data from upward of 8,500 events daily. With an internal user base of 2,000 — and growing — the company particularly appreciated the seamless data access controls and the ability to securely share data with just a few simple clicks.

Data Warehouse 103

Data Warehouse Cloud PostgreSQL Hadoop 103

Cloudera

NOVEMBER 13, 2024

Several LLMs are publicly available through APIs from OpenAI , Anthropic , AWS , and others, which give developers instant access to industry-leading models that are capable of performing most generalized tasks. Data Preparation.

Datasets 87

Datasets Machine Learning Coding Data Preparation 87

The Pragmatic Engineer

NOVEMBER 21, 2023

The rise of the internet and web-based computing (1989) ARPANET's influence expanded in the 1980s when the National Science Foundation Network (NSFNet) provided access to a network of supercomputers across the US. Third-party events like “ Oprah’s book club ” could send traffic and orders spiking 1000s of percent.

Engineering 338

Engineering Bytes Cloud Computing AWS 338

Snowflake

NOVEMBER 4, 2024

Get hands-on with tools like pandas, Document AI and Snowflake Notebooks Up-close, hands-on sessions and demos — created for builders, by builders — is what sets this event apart from other dev conferences. Go in-depth on some of Snowflake’s most popular features, like Document AI. Does it have to change how your team works too?

Unstructured Data 104

Unstructured Data Python Machine Learning Data Pipeline 104

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. In the event of these different cluster errors, what are the strategies for mitigating and recovering from those failures? Operating it at scale, however, is notoriously challenging.

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Data Engineering Weekly

OCTOBER 27, 2024

link] Event Alert: MLOps World/ Gen AI World - Austin, TX - Nov 7-8 The Gen AI Summit, consisting of a wider group of 20,000 Engineers, AI entrepreneurs, and Scientists, will host 1,000 AI teams in Austin, TX, November 7-8. Passes include app-brain-date networking, birds of a feature, post-event parties, etc. What are you waiting for?

Data Engineering 57

Data Engineering Data Engineer Engineering Unstructured Data 57

Netflix Tech

FEBRUARY 14, 2025

Collecting Raw Impression Events As Netflix members explore our platform, their interactions with the user interface spark a vast array of raw events. These events are promptly relayed from the client side to our servers, entering a centralized event processing queue.

Kafka 66

Kafka Datasets Metadata Utilities 66

The Pragmatic Engineer

JANUARY 12, 2023

Pollen was an events tech startup founded in 2015, which raised more than $200M in funding and employed about 600 people by 2022. It defied gravity by appearing to thrive at the same time as the Covid-19 pandemic shut down swathes of the events industry, worldwide. To get this newsletter every week, subscribe here.

Software Engineer 201

Software Engineer Software Engineering Engineering Raw Data 201

The Pragmatic Engineer

MARCH 13, 2023

In case you somehow missed it: we went through the fastest bank run in history, in an event that impacted about half of all VC-funded startups in the US and UK. In this special edition, I cover the events of this blow to the tech economy. For some startups, losing access to their bank account prompted drastic action.

Banking 225

Banking Insurance Portfolio Media 225

Cloudera

DECEMBER 4, 2024

access our free 5-day trial now. also includes enhancements that make operating and monitoring data pipelines easier than ever: Notifications: Stay informed about the health and performance of your data flows with customizable notifications that alert you to critical events. and its potential to revolutionize data flow management.

Data Pipeline 93

Data Pipeline Data Ingestion Data Preparation Architecture 93

Snowflake

NOVEMBER 11, 2024

Ingest data more efficiently and manage costs For data managed by Snowflake, we are introducing features that help you access data easily and cost-effectively. This reduces the overall complexity of getting streaming data ready to use: Simply create external access integration with your existing Kafka solution.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

The Pragmatic Engineer

MAY 25, 2023

Organize a “Glassdoor review event,” asking employees to leave honest reviews. Engineering leaders and engineers shared some stories: A startup organized a social event at work, and asked employees to show up on time with their laptops. However, there are companies which employ more questionable tactics. Exclusive A 1.5

Software Engineer 342

Software Engineer Software Engineering AWS Engineering 342

Striim

MARCH 14, 2025

This is why companies are abandoning traditional ETL in favor of Change Data Capture (CDC) and event-driven architectures. Events (deposits and withdrawals) are captured and streamed in real time using change data capture. Enterprises must also solve practical problems to ensure AI models dont have access to customer PII.

Government 52

Government Data Pipeline Data Lake Architecture 52

Data Engineering Podcast

NOVEMBER 26, 2023

Summary Building a data platform that is enjoyable and accessible for all of its end users is a substantial challenge. Developing event-driven pipelines is going to be a lot easier - Meet Functions! Memphis Logo]([link] Developing event-driven pipelines is going to be a lot easier - Meet Functions!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Data Engineering Weekly

NOVEMBER 3, 2024

link] Event Alert: MLOps World/ Gen AI World - Austin, TX - Nov 7-8 The Gen AI Summit, consisting of a wider group of 20,000 Engineers, AI entrepreneurs, and Scientists, will host 1,000 AI teams in Austin, TX, November 7-8. Passes include app-brain-date networking, birds of a feature, post-event parties, etc. What are you waiting for?

Data Engineering 62

Data Engineering Data Engineer Engineering Pipeline-centric 62

The Pragmatic Engineer

OCTOBER 31, 2023

Diagnosis: Customers may be unable to access Cloud resources in europe-west9-a Workaround: Customers can fail over to other zones.” We are still working on processing the backlog of asynchronous Lambda invocations that accumulated during the event, including invocations from other AWS services (such as SQS and EventBridge).

AWS 272

AWS Google Cloud Cloud Engineering 272

The Pragmatic Engineer

APRIL 9, 2024

On top of the ability to post jobs, they had access to The Pragmatic Engineer Talent Collective. As I analyzed this event in The Pragmatic Engineer: Every hiring manager I talked with told me how Stack Overflow Jobs has been the place where job ads got good candidates.

Software Engineer 311

Software Engineer Software Engineering Engineering Recruitment 311

Data Engineering Podcast

APRIL 16, 2023

As the capabilities of these systems has improved and become more accessible, the target of what self-serve means changes. Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Netflix Tech

MARCH 28, 2025

This scenario underscored the need for a new recommender system architecture where member preference learning is centralized, enhancing accessibility and utility across different models. To harness this data effectively, we employ a process of interaction tokenization, ensuring meaningful events are identified and redundancies are minimized.

Metadata 66

Metadata Bytes Entertainment Data Mining 66

ThoughtSpot

MARCH 18, 2025

Your users expect instant access to insights without switching between tools, hunting for reports, or waiting for analysts to provide answers. Automate workflows with event-driven analytics Why stop at actionable insights when you can automate what happens next? This is where embedded AI-powered analytics comes in.

Insurance 52

Insurance Banking Accessible Accessibility 52

Snowflake

JUNE 5, 2024

We couldn’t make our advancements in AI, data accessibility, monetization and more without their ongoing support and partnership, and this recognition could not be more well-deserved. The SPN has experienced incredible growth and is crucial to our most important value, putting the customer first.

Entertainment 121

Entertainment Manufacturing Retail Healthcare 121

The Pragmatic Engineer

OCTOBER 17, 2024

The startup was able to start operations thanks to getting access to an EU grant called NGI Search grant. Read the full issue here , and read this week’s The Pulse — all of them analyzing relevant events happening in the tech industry. This was one section from last week’s The Pulse.

Cloud 314

Cloud AWS Metadata Cloud Computing 314

Snowflake

FEBRUARY 13, 2025

Furthermore, most vendors require valuable time and resources for cluster spin-up and spin-down, disruptive upgrades, code refactoring or even migrations to new editions to access features such as serverless capabilities and performance improvements.

Management 82

Management Government Cloud Unstructured Data 82

Precisely

DECEMBER 16, 2024

With its ability to deliver near real-time machine log data, Ironstream ensures that these traditionally siloed systems are no longer blind spots in your IT landscape delivering a significant boost to various key areas: Security: detect automation failures, change profile events, system value changes, and more immediately.

Systems 59

Systems IT Machine Learning Insurance 59

Data Engineering Podcast

MARCH 18, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! Data Council Logo]([link] Join us at the event for the global data community, Data Council Austin.

Data Security 130

Data Security Machine Learning Data Science Metadata 130

Data Engineering Podcast

MARCH 3, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council : ![Data

Programming 162

Programming Data Lake High Quality Data Machine Learning 162

Data Engineering Podcast

FEBRUARY 25, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Promo Code: dataengpod20 Dagster : ![Dagster

Database 162

Database Technology Data Lake High Quality Data 162

Precisely

FEBRUARY 6, 2025

This is crucial for correlating events, understanding patterns, and detecting anomalies. Examples of datasets include privileged users, access to failures, and customer data. Recommendations Seek solutions that make legacy data accessible: IBM Z and IBM i data requires expertise for extraction.

IT 64

IT Management Datasets Systems 64

Netflix Tech

DECEMBER 19, 2024

For convenience, they support the dot-syntax (when possible) for accessing keys, making it easy to access values in a nested configuration. You can access Configs of any past runs easily through the Client API. This has been a guiding design principle with Metaflow since its inception. nflxfastdata(2.13.5);nflx(2.13.5);metaboost(0.0.27)

Machine Learning 81

Machine Learning Project Data Warehouse Coding 81

Engineering at Meta

JANUARY 22, 2025

However, these tools are limited by their lack of access to runtime data, which can lead to false positives from unexecuted code. Improving consumption experience : streamline the consumption experience to make it easier for developers and stakeholders to access and utilize data lineage information.

Data Warehouse 109

Data Warehouse SQL Programming Language Data 109

Zalando Engineering

NOVEMBER 8, 2023

Postgres Logical Replication at Zalando Builders at Zalando have access to a low-code solution that allows them to declare event streams that source from Postgres databases. At the time of writing, there are hundreds of these Postgres-sourced event streams out in the wild at Zalando. Simple, right?

PostgreSQL 139

PostgreSQL Java Database Bytes 139