databricks

JANUARY 24, 2025

In today's fast-paced world, utility companies face numerous challenges when it comes to outage response and restoration, especially during severe weather events.

Utilities 98

Utilities IT 98

ArcGIS

FEBRUARY 28, 2025

Learn how to use the new Migration toolset to make your utility network migration even easier.

Utilities 95

Utilities Data Management Management Data 95

Analytics Vidhya

DECEMBER 30, 2024

GenAI is already transforming how data is managed, analyzed, and utilized, paving the way for […] The post Top 11 GenAI Powered Data Engineering Tools to Follow in 2025 appeared first on Analytics Vidhya. As the field evolves, Data Engineers are stepping into a future where innovation and efficiency take center stage.

Data Engineering 145

Data Engineering Data Engineer Engineering Utilities 145

databricks

FEBRUARY 12, 2025

Utilities Of Today Todays power grid traces its roots back to the late 1800s when Pearl Street Station first serviced a handful of.

Utilities 71

Utilities Data IT Manufacturing 71

ArcGIS

APRIL 8, 2025

Learn how to use the Migration Toolset to migrate data to a utility network and deploy it to an ArcGIS Enterprise environment.

Utilities 62

Utilities Data IT Data Management 62

Start Data Engineering

JANUARY 28, 2025

The root cause of these metric deviations often stems from rapid data utilization without prioritizing long-term maintainability. Introduction If youve worked on a data team, youve likely encountered situations where multiple teams define metrics in slightly different ways, leaving you to untangle why discrepancies exist.

Utilities 147

Utilities Coding Data 147

ArcGIS

MARCH 25, 2025

Learn how to migrate data to a Utility Network Foundation using the Utility Data Management Support tools and the Data Loading toolset.

Utilities 52

Utilities Data Management Management Data 52

Engineering at Meta

JANUARY 21, 2025

Strobelight combines several technologies, many open source, into a single service that helps engineers at Meta improve efficiency and utilization across our fleet. Engineers and developers can use this information to identify performance and resource bottlenecks, optimize their code, and improve utilization. Python, Java, and Erlang).

Technology 114

Technology Metadata Utilities Engineering 114

The Pragmatic Engineer

OCTOBER 17, 2024

The name comes from the concept of “spare cores:” machines currently unused, which can be reclaimed at any time, that cloud providers tend to offer at a steep discount to keep server utilization high. Spare Cores attempts to make it easier to compare prices across cloud providers. Source: Spare Cores. Tech stack.

Cloud 314

Cloud AWS Metadata Cloud Computing 314

ArcGIS

MARCH 3, 2025

to edit, trace, and synchronize offline utility networks. Learn about the latest updates in the ArcGIS Maps SDKs for Native Apps v200.6

Utilities 57

Utilities Data Management Management Data 57

Engineering at Meta

JANUARY 22, 2025

This information is then utilized to identify relevant matches with other people who have specified matched values in their dating preferences. To address this limitation, we utilize Privacy Probes , a key component of our PAI lineage technologies. Privacy Probes automate data flow discovery by collecting runtime signals.

Data Warehouse 109

Data Warehouse SQL Programming Language Data 109

Analytics Vidhya

JUNE 24, 2023

Utilizing data modeling tools becomes […] The post Top 10 Powerful Data Modeling Tools to Know in 2023 appeared first on Analytics Vidhya. As a new developer, a robust data modeling foundation is crucial for effectively working with databases.

Database 218

Database Utilities Data Data Science 218

The Pragmatic Engineer

MARCH 12, 2024

Responsible for building and maintaining developer tools so the programmer and copilot can do their jobs better; such as improving editors, building better debugging functionality, creating utility tools and macros, etc. The tester. They come up with test cases and data. Also responsible for scaffolding of tests. 

Engineering 317

Engineering Programming Language Hospitality Programming 317

The Pragmatic Engineer

APRIL 11, 2024

This is also why banks utilize a 2-day “blackout period” which creates space to revert failed migrations or updates. In contrast, most other industries like ecommerce, utilities, airlines, etc, have no such luxury and must invest in zero-downtime migrations.

Banking 255

Banking Utilities Database Engineering 255

Snowflake

APRIL 9, 2025

SoFlo Solar SoFlo Solars SolarSync platform uses real-time AI data analytics and ML to transform underperforming residential solar systems into high-uptime clean energy assets, providing homeowners with savings while creating a virtual power plant network that delivers measurable value to utilities and grid operators.

Pharmaceutical 98

Pharmaceutical Manufacturing Data Ingestion SQL 98

The Pragmatic Engineer

JUNE 13, 2023

But there’s no “one size fits all” strategy when it comes to deciding the right balance between utilizing the cloud and operating your infrastructure on-premises. What are the use cases where the company already utilizes public cloud? Agoda utilizes Akamai as its CDN vendor. Agoda in numbers Agoda lists 3.6M

Cloud 232

Cloud Database Utilities BI 232

The Pragmatic Engineer

JULY 6, 2023

The company utilizes Google Cloud to some extent, and my understanding from talking with Twitter engineers is that this was for machine learning (ML) use cases. It surely helped the Threads team that they could utilize the infrastructure of Instagram. Twitter runs its infrastructure on three of its own data centers.

Google Cloud 252

Google Cloud Media Cloud Utilities 252

Netflix Tech

DECEMBER 17, 2024

Our ecosystem enables engineering teams to run applications and services at scale, utilizing a mix of open-source and proprietary solutions.

Engineering 84

Engineering Entertainment Amazon Web Services Utilities 84

ArcGIS

MARCH 27, 2025

Extending the benefits of GIS into facilities enables data-driven decisions, enhanced operational efficiency, and optimized performance.

Utilities 62

Utilities Management Data 62

Netflix Tech

MARCH 28, 2025

This scenario underscored the need for a new recommender system architecture where member preference learning is centralized, enhancing accessibility and utility across different models. Utilizing embeddings The model generates valuable embeddings for members and entities like videos, games, and genres.

Metadata 71

Metadata Bytes Data Mining Entertainment 71

Cloudera

JANUARY 7, 2025

A leading meal kit provider migrated its data architecture to Cloudera on AWS, utilizing Cloudera’s Open Data Lakehouse capabilities. Several organizations utilize multiple cloud providerssuch as AWS, Azure, and Google Cloudto enhance risk mitigation.

Cloud 82

Cloud Government AWS Unstructured Data 82

Scott Logic

MARCH 6, 2025

I am still incredibly optimistic about LLMs and their utility, but we dont need models that perform even better on some abstract benchmarks, we need models and tools that respond no, Im afraid I cannot do that, or can we break this task down, or can we discuss this a bit further.

Coding 104

Coding Building Utilities Programming 104

Pinterest Engineering

MARCH 19, 2025

Utility We combined the predictions from these multiple heads to get a single score used to rank the modules. Given business insights about the relative importance of each action along with offline and online tuning, we determine a utility value that is a weighted sum of all prediction scores from the moduleranker.

Utilities 46

Utilities Building Systems Engineering 46

databricks

AUGUST 2, 2024

To fully utilize raw data stored as tables in Databricks, running. Training a high-quality machine learning model requires careful data and feature preparation.

Engineering 135

Engineering Raw Data Machine Learning Utilities 135

Engineering at Meta

FEBRUARY 3, 2025

The service continues to utilize TAI timestamps but can return UTC timestamps to clients via the API. Each time the library is called during the smearing period we adjust the return values based on the smearing algorithm, which shifts the time values 1 nanosecond every 62.5 microseconds.

Algorithm 87

Algorithm Utilities Systems Engineering 87

Ascend.io

NOVEMBER 14, 2024

This elasticity allows data pipelines to scale up or down as needed, optimizing resource utilization and cost efficiency. Utilize Cloud-Native Tools: Leverage cloud-native data pipeline tools like Ascend to build and orchestrate scalable workflows. Regularly review usage patterns and adjust cloud resource allocation as needed.

Data Pipeline 52

Data Pipeline Amazon Web Services Data Integration Data 52

The Pragmatic Engineer

JUNE 1, 2023

Hardcoding secrets in production is poor practice. We covered how Stack Overflow learned this the hard way, a few months back.

Education 363

Education Project PostgreSQL Software Engineering 363

Edureka

JANUARY 2, 2025

Even the most complex workflows may be easily handled by developers by utilizing Angular’s RxJS capabilities. ajax(): Utilizes XMLHttpRequest to execute an HTTP request and returns the server response as an observable. These operators are essential for enabling reactive work with asynchronous processes and data streams.

Utilities 52

Utilities Coding Programming Project 52

Data Engineering Weekly

MARCH 23, 2025

link] Salesforce: How to ETL at Petabyte-Scale with Trino Can you utilize Trino for running your ETL pipeline or simply for ad-hoc analytics? link] LinkedIn: Journey of next-generation control plane for data systems LinkedIn writes about the evolution of Nuage, its internal control plane framework for managing data infrastructure resources.

Data Engineering 62

Data Engineering Data Engineer Engineering Data 62

Pinterest Engineering

FEBRUARY 23, 2023

Though these browsers utilize HTTP/3, there may be compatibility issues, which could break the Pinterest web app. Current State We have enabled HTTP/3 on critical traffic types and upgraded/leveraged mobile clients’ network stacks to utilize HTTP/3. Android Video has utilized HTTP3 through Exoplayer+Cronet.

Bytes 140

Bytes Media Software Engineer Software Engineering 140

KDnuggets

OCTOBER 22, 2024

Utilize these transformation techniques in your data workflow.

Data Workflow 123

Data Workflow Utilities Data 123

Seattle Data Guy

AUGUST 8, 2024

But whether AI is hype or reality doesn’t change the fact that data engineers will play a major role in ensuring that the data sets that are utilized for the growing use cases are usable both by machines and humans. If you work in data, then AI is everywhere at this point.

Data Engineering 130

Data Engineering Data Engineer Engineering Utilities 130

The Pragmatic Engineer

AUGUST 10, 2023

Before we start: plenty of people who subscribe to the newsletter utilize a learning and development budget their company provides. However, it can compete by offering tools for companies to utilize their own internal knowledge bases, and by ensuring that internal company data doesn’t leave the premises.

Retail 188

Retail Utilities Software Engineer Software Engineering 188

Snowflake

FEBRUARY 3, 2025

Leaders are demanding clear ROI from gen AI, with 2025 marking a shift toward utility over hype. Lack of technical expertise: Scaling AI requires specialized knowledge that many organizations have yet to develop. AI investments are now facing the same rational scrutiny as any technological expenditure.

Government 94

Government Data Governance Accessibility Accessible 94

Data Engineering Weekly

FEBRUARY 18, 2025

In contrast, Fluss is a storage to store real-time streaming data but doesn't provide OLAP abilities; it utilizes external query engines to process/analyze data, such as Flink and StarRocks/Spark/Trino (on the roadmap). We utilize the same approach with Kafka, the synchronous replication, and the ISR (in-sync-replicas) strategy.

Kafka 73

Kafka Lambda Architecture SQL Architecture 73

KDnuggets

NOVEMBER 26, 2024

Learn how to utilize this advanced AI-driven IDE for your work.

Coding 121

Coding Utilities 121

Engineering at Meta

APRIL 13, 2023

As this is rolled out, security-conscious users who utilize the verify security code page will notice this verification process occurs quickly and automatically. The private key is what you utilize to decrypt your messages sent from another party and never leaves your device. per minute.

Utilities 136

Utilities Coding Database Accessibility 136