Confessions of a Data Guy

OCTOBER 3, 2024

I’ve been hacking around with tools and programming since Perl was a thing. I’ve worked the gambit of Data Platforms from large organizations to tiny startups, and all those in between. I’ve worked on Data Platforms that dropped ungodly amounts of money on SAP products, and places where we would build our own massive data […] The post Hosted (SaaS) vs DIY Data Tools appeared first on Confessions of a Data Guy.

Data 113

Data Programming Building Data Engineering 113

KDnuggets

OCTOBER 3, 2024

Learn the data engineering tools for data orchestration, database management, batch processing, ETL (Extract, Transform, Load), data transformation, data visualization, and data streaming.

Data Engineering 127

Data Engineering Data Engineer Engineering Data 127

dbt Developer Hub

OCTOBER 3, 2024

If you haven’t paid attention to the data industry news cycle, you might have missed the recent excitement centered around an open table format called Apache Iceberg™. It’s one of many open table formats like Delta Lake, Hudi, and Hive. These formats are changing the way data is stored and metadata accessed. They are groundbreaking in many ways. But I have to be honest: I don’t care.

Metadata 86

Metadata Data Lake Data Storage Accessible 86

KDnuggets

OCTOBER 3, 2024

Want to create data science resumes that land interview calls and jobs? Avoid these common mistakes.

Data Science 106

Data Science Data 106

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Engineering at Meta

OCTOBER 3, 2024

Data for Good at Meta is open-sourcing the data used to train our AI-powered population maps. We’re hoping that researchers and other organizations around the world will be able to leverage these tools to assist with a wide range of projects including those on climate adaptation, public health and disaster response. The dataset and code are available now on GitHub.

Datasets 65

Datasets Government Banking Programming 65

Precisely

OCTOBER 3, 2024

Key Takeaways: As you embark on your own migration journey, there are some key big-picture questions to consider around the best approach to take for your business. In reviewing best practices for your AWS cloud migration, it’s crucial to define your business case first, and work from there. Migrating to AWS can unlock incredible value for your business, but it requires careful planning, risk management, and the right technical and organizational strategies.

AWS 64

AWS Cloud Amazon Web Services Data Integration 64

Towards Data Science

OCTOBER 3, 2024

Three important lessons I have learned on my journey as data engineer and architect Continue reading on Towards Data Science »

Data Architecture 58

Data Architecture Architecture Data Science Data 58

Monte Carlo

OCTOBER 3, 2024

As a data analyst, you’re responsible for delivering trusted insights to your stakeholders. Unfortunately, that trust often comes at the cost of your time (and maybe a little sleep as well). The truth is, most analysts lose hours profiling their data, identifying thresholds, creating manual rules , and following up on data quality issues—all to make sure the data products they deliver to stakeholders meet six dimensions of data quality or more.

SQL 52

SQL Government Data Data Engineering 52

Striim

OCTOBER 3, 2024

In the fast-paced world of retail, the ability to harness data effectively is crucial for staying ahead. On September 18, 2024, at Big Data London, Morrisons shared its digital transformation journey through the presentation, “Learn How Morrisons is Accelerating the Availability of Actionable Data at Scale with Google and Striim.” Peter Laflin , Chief Data Officer at Morrisons, outlined the supermarket chain’s strategic partnership with Striim, a global leader in real-time data integ

Google Cloud 52

Google Cloud Cloud Retail Manufacturing 52

Hevo

OCTOBER 3, 2024

Amazon Redshift is an online, petabyte-scale Data Warehouse service. It is dedicated to enterprise use, collecting large amounts of data and extracting analysis and insights from it. Redshift helps organizations query large DBs in real-time. Nonetheless, Redshift provides flexibility in performance as long as the cost aspect is well-handled to minimize cloud expenses.

AWS 40

AWS Data Warehouse Cloud IT 40

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Knowledge Hut

OCTOBER 3, 2024

PMP certification validates your skills as a project manager and significantly enhances your career, similar to higher education but with a focus on practical experience. Before pursuing the certification, it’s crucial to weigh the advantages and disadvantages of project management. A table for advantages and disadvantages would be beneficial, as it helps clarify the pros and cons of the PMP process.

Certification 52

Certification Education Project SQL 52

Snowflake

OCTOBER 3, 2024

For the past couple years, generative AI has been the hot-button topic across my conversations with customers, prospects, partners and everyone in between. People want to know how they can harness the power of AI to become more innovative, efficient and competitive — and they want to do it as soon as possible. For many organizations, however, turning AI ideas into reality has proven elusive, with Harvard Business Review reporting that up to 80% of AI projects fail to make it into production.

Electronics 60

Electronics Portfolio BI Finance 60

Snowflake

OCTOBER 3, 2024

Natural language is rapidly becoming the bridge between human and machine communication. But hallucinations — when a model generates a false or misleading answer — continue to be the biggest barrier to the adoption of generative AI. Retrieval-augmented generation (RAG) allows enterprises to ground responses from LLMs in their specific organization’s data, reducing hallucinations, improving contextualized understanding and improving explainability.

Cloud 61

Cloud Data Governance Machine Learning Government 61