Towards Data Science

AUGUST 22, 2023

Advice from a startup founder in the data space on how to find a startup that works for you Photo by Leeloo Thefirst from Pexels.com So you want to join a startup huh? I’m not talking about a fancy Series E startup that’s about to go IPO funded by a16z. I’m talking about a real startup, from seed to series B — where every day can feel like you’re either about to soar or crash and burn — and there’s little in between.

Data Engineer 88

Data Engineer Data Engineering Engineering Data Pipeline 88

Seattle Data Guy

AUGUST 9, 2023

Learning about how to data models from basic star schemas on the internet is like learning data science using the IRIS data set. It works great as a toy example. But it doesn’t match real life at all. Data modeling in real life requires you fully understand the data sources and your business use cases.… Read more The post Why Is Data Modeling So Challenging – How To Data Model For Analytics appeared first on Seattle Data Guy.

Data Science 246

Data Science Data Consulting IT 246

The Pragmatic Engineer

AUGUST 1, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. To get full issues twice a week, subscribe here. The past month, we’ve done deepdives in the newsletter on what a senior software engineer is at Big Tech , and at scaleups.

Software Engineer 245

Software Engineer Software Engineering Engineering Designing 245

Analytics Vidhya

AUGUST 30, 2023

Introduction In the bustling arena of database management systems, two heavyweight contenders emerge, each carrying its arsenal of features and capabilities. In one corner, we have the suave and sophisticated Microsoft SQL Server (MSSQL), donned in the elegance of enterprise-level prowess. And in the other corner the scrappy and open-source MySQL, armed with its community-driven […] The post MSSQL vs MySQL: Comparing Powerhouses of Databases appeared first on Analytics Vidhya.

MySQL 228

MySQL Database SQL Systems 228

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Waitingforcode

AUGUST 22, 2023

One of the great features of modern table file formats is the ability to handle write conflicts. It wouldn't be possible without commits that are the topic of this new blog post.

IT 130

IT 130

Data Engineering Podcast

AUGUST 27, 2023

Summary Data persistence is one of the most challenging aspects of computer systems. In the era of the cloud most developers rely on hosted services to manage their databases, but what if you are a cloud service? In this episode Vignesh Ravichandran explains how his team at Cloudflare provides PostgreSQL as a service to their developers for low latency and high uptime services at global scale.

Database 130

Database Building PostgreSQL BI 130

KDnuggets

AUGUST 31, 2023

The Burtch Works 2023 Data Science & AI Professionals salary report is here, and includes insightful data such as hiring and marketplace trends, compensation changes over time, and salary data. Get your copy here.

Data Science 150

Data Science Data 150

The Pragmatic Engineer

AUGUST 22, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of for topics from the past newsletter issue Game Development Basics. To get the full issues, twice a week, subscribe here.

Software Engineer 207

Software Engineer Software Engineering Consulting Entertainment 207

Analytics Vidhya

AUGUST 22, 2023

Introduction In today’s data-driven world, seamless data integration plays a crucial role in driving business decisions and innovation. Two prominent methodologies have emerged to facilitate this process: Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT). In this article, we will discuss ELT vs ETL, comparing their characteristics, benefits, and suitability for various use cases. […] The post ELT vs ETL: Unveiling the Differences and Similarities appeared first on Ana

Data Integration 185

Data Integration Process Datasets Data 185

Waitingforcode

AUGUST 29, 2023

If Delta Lake implemented the commits only, I could stop exploring this transactional part after the previous article. But as for RDBMS, Delta Lake implements other ACID-related concepts. One of these are isolation levels.

130

130

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

databricks

AUGUST 30, 2023

It’s no secret that modern organizations are doubling down on their investments in data - investments that uncover deep customer insights that provide a.

Data 124

Data 124

Snowflake

AUGUST 30, 2023

In the past few days, the scope and trajectory of Instacart’s use of Snowflake has been misrepresented by some on social media. Snowflake has partnered closely with Instacart to scale up to meet the company’s massive demand growth, and then to optimize for efficiency. Optimizations are undertaken on a workload-by-workload basis, and have been extremely successful.

Media 115

Media Retail Machine Learning Data Pipeline 115

KDnuggets

AUGUST 30, 2023

7 Projects Built with Generative AI • Beyond Numpy and Pandas: Unlocking the Potential of Lesser-Known Python Libraries • 5 Ways You Can Use ChatGPT’s Code Interpreter For Data Science • GPT-4: 8 Models in One; The Secret is Out

Python 142

Python Project Data Science Coding 142

The Pragmatic Engineer

AUGUST 10, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of five topics from today’s subscriber-only The Pulse issue. To get full issues twice a week, subscribe here.

Engineering 196

Engineering Recruitment Retail Software Engineering 196

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Towards Data Science

AUGUST 29, 2023

Data Quality Chronicles Missing data, missing mechanisms, and missing data profiling Missing Data prevents data scientists to see the entire story the data has to tell. Sometimes, even the smallest pieces of information can provide a completely unique view of the world. Photo by Ronan Furuta on Unsplash. Earlier this year, I started a piece on several data quality issues (or characteristics) that heavily compromise our machine learning models.

Datasets 102

Datasets Machine Learning Data Data Science 102

Robinhood

AUGUST 30, 2023

Bitcoin and Dogecoin support is now available to all Robinhood Wallet users, and in-app Ethereum Swaps started rolling out today Since launching to the general public nearly six months ago, Robinhood Wallet has seen significant adoption globally, with hundreds of thousands of users in more than 140 countries worldwide. We are always gathering feedback, and have heard loud and clear that people want access to more coins on more chains.

Insurance 99

Insurance Accessible Accessibility Programming 99

ThoughtSpot

AUGUST 31, 2023

I’m calling it now. The next battleground for analytics adoption among business users will be the productivity suite. Let’s unpack that statement by considering these two examples: You finally get your data visualization just how you want it for your presentation. Now, you take a screenshot and copy-paste it into your slide deck. You pull your dashboard data into Google Sheets so you can perform ad-hoc analysis and collaborate with various stakeholders who don’t have dashboard access.

Google Cloud 98

Google Cloud BI Government Cloud 98

Monte Carlo

AUGUST 10, 2023

Editor’s Note : So much has happened since we first published this post and created the data observability category and Monte Carlo in 2019. We have updated this post to reflect this rapidly maturing space. You can read the original article linked at the bottom of this page. What is Data observability? The five pillars My data observability definition has not changed since I first coined it in 2019: Data observability refers to an organization’s comprehensive understanding of the health an

Data Pipeline 98

Data Pipeline Software Engineer Software Engineering Machine Learning 98

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

AUGUST 29, 2023

Join us at the MADS conference in Washington, D.C., from Sept. 26 to 28, 2023. Learn more here and register with code KDN100 for $100 of your conference pass.

Data Science 145

Data Science Coding Data 145

The Pragmatic Engineer

AUGUST 10, 2023

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover one out of five topics from today’s subscriber-only The Pulse issue. To get full issues twice a week, subscribe here.

Retail 176

Retail Utilities Software Engineering Software Engineer 176

Zalando Engineering

AUGUST 2, 2023

Introduction Since 2021, Zalando invested in building up a developer portal called Sunrise, aimed to become the starting point for Builders at Zalando. The portal is based on Spotify's Backstage platform with additional extensions built internally. Sunrise enables everyone at Zalando to view and discover information about teams, applications, APIs, events, CI/CD pipelines, Infrastructure accounts and costs, and much more.

Software Engineer 98

Software Engineer Software Engineering Engineering Data Pipeline 98

InData Labs

AUGUST 24, 2023

The world is generating an unprecedented amount of data every second. From online transactions and social media interactions to sensor readings and scientific research, the sheer volume, velocity, and variety of data have given rise to the concept of “Big data.” This vast ocean of information holds immense potential, capable of revolutionizing industries, driving innovation, Запись 16+ fascinating Big data examples впервые появилась InData Labs.

Big Data 98

Big Data Media Data BI 98

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

ThoughtSpot

AUGUST 23, 2023

I recently watched the movie Air. I absolutely loved it. Note: if you don’t want spoilers, you may want to skip the next two paragraphs. Air is a story chronicling how Nike, the underdog in those days, steals Michael Jordan away from Adidas and Converse. With the cards stacked against Nike—they had a much smaller budget than their big-brand competitor, Adidas—it was conventionally assumed that Michael was better off signing with a more established brand.

BI 98

BI Metadata Data Warehouse Data Governance 98

Monte Carlo

AUGUST 21, 2023

You did it! After executive leadership vaguely promised stakeholders that new Gen AI features would be incorporated across the organization, your tiger team sprinted to produce a MVP that checks the box. Integrating that OpenAI API into your application wasn’t that difficult and it may even turn out to be useful. But now what happens? Tiger teams can’t sprint forever.

Data Science 98

Data Science Machine Learning Media Data 98

KDnuggets

AUGUST 31, 2023

Buckle up for the Generative AI gold rush! Will BigTech rule with its picks and shovels? Which startups will strike it rich? Will “copilot for X” be the business strategy to hit pay dirt? How can startups dig moats to keep out other prospectors? And will the US once again have the richest gold seams?

IT 115

IT 115

The Pragmatic Engineer

AUGUST 3, 2023

👋 Hi, this is Gergely with a free issue of the Pragmatic Engineer Newsletter. We cover one out of five topics in today’s subscriber-only The Pulse issue. If you’re not yet a full subscriber, you missed this week’s deepdive: The 2023 tech market, as seen by hiring managers. To get full newsletters twice a week, subscribe here.

Metadata 163

Metadata Engineering Building Technology 163

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

Precisely

AUGUST 3, 2023

The results are in! The 2023 Data Integrity Trends and Insights Report , published in partnership between Precisely and Drexel University’s LeBow College of Business, delivers groundbreaking insights into the importance of trusted data. For the report, more than 450 data and analytics professionals worldwide were surveyed about the state of their data programs.

Data Integration 98

Data Integration Data Programming Programming Data 98

databricks

AUGUST 23, 2023

To build customer support bots, internal knowledge graphs, or Q&A systems, customers often use Retrieval Augmented Generation (RAG) applications which leverage pre-trained models.

Building 97

Building Systems 97

ThoughtSpot

AUGUST 22, 2023

In the past, it was commonly believed that only administrators or designated support contacts benefited from live product support. But that shortsighted view fails to acknowledge the reality that every user—be you an occasional business user, tenured analyst, or in-the-weeds IT administrator—can encounter roadblocks and require assistance. That's why our new In-App Support is available to all users worldwide, regardless of their role.

Data 98

Data Designing Accessible Accessibility 98

Towards Data Science

AUGUST 2, 2023

A Step-by-Step Guide to Building an Effective Data Quality Strategy from Scratch How to build an interpretable data quality framework based on user expectations Photo by Rémi Müller on Unsplash As data engineers, we are (or should be) responsible for the quality of the data we provide. This is nothing new, but every time I join a data project I ask myself the same questions: When should I start working on data quality?

Building 98

Building Data Consolidation Data Datasets 98

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

Systems