Confessions of a Data Guy

AUGUST 20, 2024

Recently, for some unknown reason, I was pursuing the new Stackoverflow … called Reddit, for Data Engineering … and I ran across an interesting question … more or less it was related to “what makes a good Software Engineer … in a Data Engineering context.” This isn’t the first time this idea has come up […] The post What is a “Good” Data or Software Engineer?

Software Engineer 113

Software Engineer Software Engineering Engineering Data Engineering 113

Engineering at Meta

AUGUST 20, 2024

Delivering new AI technologies at scale also means rethinking every layer of our infrastructure – from silicon and software systems and even our data center designs. For the second year in a row, Meta’s engineering and infrastructure teams returned for the AI Infra @ Scale conference, where they discussed the challenges of scaling up an infrastructure for AI as well as work being done on our large-scale GPU clusters , open hardware designs for next-generation data center hardware, and how Meta i

Engineering 94

Engineering Designing Technology Systems 94

databricks

AUGUST 20, 2024

Special thanks to Kevin Glover, Martin Ko, Kuber Sharma and the team at Tableau for their valuable insights and contributions to this blog.

111

111

Cloudera

AUGUST 20, 2024

By now, every organization, regardless of industry, has at least explored the use of AI, if not already embraced it. In today’s market, the AI imperative is firmly here, and failing to act quickly could mean getting left behind. But even as adoption soars, struggles remain, and scalability continues to be a major issue. Organizations are quick to adopt AI, but getting it established across the organization brings a unique set of challenges that come into play.

Government 78

Government Data Lake Data Governance Data Architecture 78

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

AUGUST 20, 2024

This article explains the basics of time series analysis. Learn to prepare your data and visualize trends in R.

Data 102

Data Programming 102

Snowflake

AUGUST 20, 2024

Healthcare and life sciences professionals face unique challenges when they want to use customer data. Much of this data is sensitive and highly regulated by laws like HIPAA. Data also tends to be fragmented between disparate systems, serving different stakeholders, such as patients, providers, business teams, insurance companies and more. These challenges are worth grappling with.

Healthcare 52

Healthcare Hospitality Electronics Government 52

Cloudyard

AUGUST 20, 2024

Read Time: 1 Minute, 13 Second Imagine a scenario where a business needs to automatically generate and send customer invoices at the end of each month. The invoices are generated from transaction data store in Snowflake, and customer receives an email with invoice attach as a CSV file. This use case requires a solution that can not only generate the invoices but handle email distribution with attachments.

Utilities 52

Utilities Coding Accessibility Accessible 52

KDnuggets

AUGUST 20, 2024

Learn how to build the recommendation system with advanced technology.

Systems 105

Systems Building Technology Machine Learning 105

Hevo

AUGUST 20, 2024

When it comes to orchestrating workflows and managing data pipelines, Luigi and Airflow are two of the most popular tools in the industry. Both have their own unique strengths and use cases, but choosing between them can be challenging.

Data Pipeline 52

Data Pipeline Management IT Data 52

Monte Carlo

AUGUST 20, 2024

Despite what the LinkedIn influencers will tell you, building useful AI applications takes more than a bunch of third-party data and an API call to ChatGPT. The real value of AI lies in the data that feeds it. Behind every successful AI product is a series of purpose-built pipelines powered by rich datasets – and the tools, processes, and people that support them.

Data 52

Data Government Datasets Designing 52

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Hevo

AUGUST 20, 2024

Data has become the foundation of any successful business. The ability to efficiently extract, transform, and load data for analysis is crucial for making informed data-driven decisions. Therefore, the tools you choose for managing your business data are also extremely important. This blog will discuss two such tools: dbt and Airflow.

Management 52

Management Data Data Engineering Data Engineer 52

DataKitchen

AUGUST 20, 2024

DataOps, the promising future that nobody seems to be able to make reality. But not for lack of trying: meet Chris Bergh, "Head Chef" at DataKitchen, joining us again to tell us how te filed evolved over the last few years. To get in.

52

52

Striim

AUGUST 20, 2024

In today’s fast-paced retail environment, digital transformation is essential to stay competitive. One powerful way to achieve this transformation is by modernizing data architecture and migrating to the cloud. There are countless ways to leverage Striim but this is one of the most exciting, as the platform offers large retailers the tools they need to seamlessly transition from legacy systems to a more agile, cloud-based infrastructure.

Retail 52

Retail Cloud Google Cloud Data Architecture 52

DareData

AUGUST 20, 2024

Learn how AI Agents can transform your customer support processes In today’s world, the way businesses interact with customers is evolving rapidly. AI agents, powered by advanced technologies like large language models (LLMs) and natural language processing (NLP), are revolutionizing customer support. In the past, deploying chatbots often led to customer dissatisfaction.

Technology 52

Technology Project Database Machine Learning 52

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Scott Logic

AUGUST 20, 2024

To begin with a quote regularly and erroneously attributed to Henry Ford , “If I had asked my customers what they wanted, they would have said a faster horse.” A lot of the hype surrounding the latest developments in Generative AI (GenAI) focuses on its potential to carry out particular tasks much faster than humans. It’s an understandable human impulse to look for ways to speed up time-consuming (boring?

Government 52

Government Consulting Medical Data Science 52

databricks

AUGUST 20, 2024

An MBA intern’s summer experience: curating a custom Databricks AI/BI Genie Space to answer critical data questions and speed up enterprise workflows by 10X.

BI 52

BI Data 52

Hevo

AUGUST 20, 2024

Ensuring the quality and reliability of data is crucial in today’s data-driven world, as it is essential for making informed decisions and improving operational efficiency. This is where data observability comes into play. It is understanding, diagnosing, and managing data health throughout the lifecycle.

SQL 40

SQL Data Cloud Management 40

Edureka

AUGUST 20, 2024

You might be willing to become a future planning manager and be a part of the successful days of your business. Prince2 Project planning offers people like you the skills and knowledge needed. This will help you to plan, execute, and implement projects properly and efficiently. Different topics like project start-up, scope definition, budgeting, scheduling, risk management, and stakeholder communication are covered in the courses.

Project 40

Project Utilities Designing Management 40

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems

Pinterest Engineering

AUGUST 20, 2024

Ning Zhang; Sr. Technical Program Manager | Ang Xu; Principal Machine Learning Engineer | Claire Liu; Staff Software Engineer | Haichen Liu; Staff Software Engineer | Yiran Zhao; Staff Software Engineer | Haoyu He; Sr. Software Engineer | Sergei Radutnuy; Sr. Machine Learning Engineer | Di An; Sr. Software Engineer | Danyal Raza; Sr. Software Engineer | Xuan Chen; Sr.

Systems 57

Systems Software Engineer Software Engineering Java 57

Edureka

AUGUST 20, 2024

We shall explore several Prince2 techniques during this post. These methodical techniques help teams effectively begin, organize, complete, oversee, and conclude Prince2s. Scrum, Waterfall, and Agile techniques are a couple of examples. To ensure the success of Prince2 Certification, each Prince2 management methodology offers unique roles, procedures, and deliverables.

Project 40

Project Management Certification Healthcare 40

Edureka

AUGUST 20, 2024

In this article, we will briefly examine AWS’s well-architected framework, try to understand its six principles, and explain why they are essential. We aim to offer you all a simplistic guideline with comprehensible and concise information. Table of Content What is AWS Well-Architected Framework? The 6 Pillars of the AWS Well-Architected Framework Operational Excellence Security Reliability Performance Efficiency Cost Optimization Sustainability Why the AWS Well-Architected Framework is Im

AWS 40

AWS Amazon Web Services Cloud Computing Cloud 40

Edureka

AUGUST 20, 2024

Prince2 is intended to supply a thorough understanding of risk identification, assessment, and mitigation during a certain sector. Techniques for risk analysis, risk assessment frameworks, and risk communication methods are a number of the themes covered in these courses. To enhance their risk management abilities, students also study business continuity planning, crisis management, and regulatory compliance.

Process 40

Process Management Certification Project 40

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

Project