KDnuggets

OCTOBER 16, 2024

Where can you find projects dealing with advanced ML topics? GitHub is a perfect source with its many repositories. I’ve selected ten to talk about in this article.

Machine Learning 158

Machine Learning Project IT 158

Cloudyard

NOVEMBER 1, 2024

To solve this, we’ll apply Projection Policies to ensure that only certain roles can see sensitive columns like Customer numbers. Snowflake provides several layers of data security, including Projection Policies , Masking Policies , and Row Access Policies , that work together to restrict access based on roles.

Data Security 52

Data Security Accessibility Accessible Project 52

Data Engineering Podcast

NOVEMBER 19, 2023

Summary The dbt project has become overwhelmingly popular across analytics and data engineering teams. Dustin Dorsey and Cameron Cyr co-authored a practical guide to building your dbt project. In this episode they share their hard-won wisdom about how to build and scale your dbt projects. What was your path to adoption of dbt?

Project 147

Project Data Lake SQL High Quality Data 147

The Pragmatic Engineer

FEBRUARY 2, 2023

Remember, Apple is very strict about forbidding even team-sensitive information from being shared by co-workers with no authorization for a project. Back then, I wrote : “Apple rolled out RTO in a staged fashion, adding an additional day/week in the office every month. Apple struggled with office space in London because of hiring.

IT 161

IT Software Engineer Software Engineering Media 161

RandomTrees

NOVEMBER 25, 2024

Solution: Generative AI-Driven Customer Insights In the project, Random Trees, a Generative AI algorithm was created as part of a suite of models for data mining the patterns from patterns in data collections that were too large for traditional models to easily extract insights from. One of the primary issues is data privacy.

Telecommunication 52

Telecommunication IT Unstructured Data Data Mining 52

KDnuggets

AUGUST 30, 2024

Data engineering is best learned by doing projects. Here are six projects focusing on different data engineering skills to ensure you have it all covered. But which ones?

Data Engineering 120

Data Engineering Data Engineer Project Engineering 120

KDnuggets

APRIL 7, 2025

Doing data science projects can be demanding, but it doesnt mean it has to be boring. Here are four projects to introduce more fun to your learning and stand out from the masses.

Data Science 132

Data Science Project Data IT 132

The Pragmatic Engineer

SEPTEMBER 19, 2024

This project helped onboard me to the software, its structure, its build, and our issue tracking and version control workflows. My first project was supporting i18n (internationalization) in the app. Without the backing of management, a large-scale rewrite is likely to fail. With this, it’s over to Lou.

Recruitment 285

Recruitment Java Coding Project 285

KDnuggets

SEPTEMBER 17, 2024

In this post, you'll learn what BigQuery is, understand its capabilities, and set up a project in Google Cloud which we will later use to practice using BigQuery for loading, querying, and analyzing data.

Project 113

Project Google Cloud Cloud Management 113

Data Engineering Podcast

MARCH 31, 2024

To bring observability to dbt projects the team at Elementary embedded themselves into the workflow. Can you start by outlining what elements of observability are most relevant for dbt projects? Can you describe what Elementary is and how it is designed to enhance the development and maintenance work in dbt projects?

Project 130

Project Data Lake High Quality Data Data Workflow 130

The Pragmatic Engineer

OCTOBER 10, 2024

  Heavy development investment:  Automattic – a VC-funded company founded by Matt Mullenweg – is the largest contributor to Wordpress, paying  more than 100 staff  to work full-time on the project. Automattic generates most of its revenue by offering managed Wordpress hosting. 25 Sep: Hit back.  Automattic

Consulting 345

Consulting AWS Engineering Software Engineer 345

The Pragmatic Engineer

OCTOBER 18, 2024

Automattic is the VC-funded company behind WordPress, the largest ongoing contributor to the project, as well as the company that controls the commercial WordPress trademark. Imagine Apple decided Spotify was a big enough business threat that it had to take unfair measures to limit Spotify’s growth on the App Store.

Engineering 356

Engineering Government Project AWS 356

Snowflake

APRIL 22, 2025

Bringing your AI technology to a data foundation that is easy, trusted and connected reduces the challenges that can delay a project or lead to unexpected costs. Early enterprise adopters of generative AI have made it clear that a robust data strategy is the cornerstone of any successful AI initiative.

IT 53

IT Unstructured Data Government Cloud 53

KDnuggets

SEPTEMBER 18, 2024

Versioning Best Practices for Data Science Projects As I have mentioned, this article assumes you have basic versioning knowledge. You don’t necessarily need to be adept at it, but at least you already have a Git version tool in the environment. If you haven’t, please follow the instructions for installation on the Git website.

Data Science 108

Data Science Project Data IT 108

WeCloudData

MARCH 20, 2025

NLP plays a crucial role in multiple domains and NLP projects ranging from its automating customer service, improving search engines, or analyzing social media sentiments. Natural Language Processing (NLP) has transformed technology by allowing machines to understand, decode, and generate human language.

Project 52

Project Media Technology Engineering 52

The Pragmatic Engineer

SEPTEMBER 22, 2023

It begins with a clean state, and can ship something that works for, say, 90% of existing Node projects, and break the remaining 10%. Bun has other contributors, but Jared writes the lion’s share of code. Bun is a backend JavaScript runtime that is an alternative to Node.js Many developers are giving Bun a go. But how is Bun so fast?

Programming Language 305

Programming Language Project Coding Engineering 305

Christophe Blefari

MARCH 1, 2023

dbt Labs also develop dbt Cloud which is a cloud product that hosts and runs dbt Core projects. a dbt project — a dbt project is a folder that contains all the dbt objects needed to work. You can initialise a project with the CLI command: dbt init. In a dbt project you can define YAML file everywhere.

Data Warehouse 278

Data Warehouse SQL Metadata Raw Data 278

The Pragmatic Engineer

MARCH 12, 2024

The title of the book takes aim at the “myth” that software development can be measured in “man months,” which Brooks disproves in the pages that follow: “Cost [of the software project] does indeed vary as the product of the number of men and the number of months. Progress does not. The copilot. The editor.

Engineering 319

Engineering Programming Language Hospitality Programming 319

dbt Developer Hub

APRIL 20, 2025

In particular, we expect both Business Intelligence and Data Engineering will be driven by AI operating on top of the context defined in your dbt Projects. Weve known for a while that the combination of structured data from your dbt project + LLMs is a potent combo (particularly when using the dbt Semantic Layer). Why does this matter?

Structured Data 98

Structured Data SQL BI Project 98

Netflix Tech

DECEMBER 19, 2024

Many of these projects are under constant development by dedicated teams with their own business goals and development best practices, such as the system that supports our content decision makers , or the system that ranks which language subtitles are most valuable for a specific piece ofcontent.

Machine Learning 85

Machine Learning Project Data Warehouse Coding 85

Analytics Vidhya

FEBRUARY 28, 2024

Introduction Data is fuel for the IT industry and the Data Science Project in today’s online world. IT industries rely heavily on real-time insights derived from streaming data sources. Handling and processing the streaming data is the hardest work for Data Analysis.

MongoDB 222

MongoDB Data Pipeline Kafka Building 222

The Pragmatic Engineer

AUGUST 22, 2023

Tommy has built his own video games, consulted on a wide variety of game projects, and for a decade has taught game development at various universities. Each project typically takes several years to create, with shifting hardware specifications and emerging competitors and trends to anticipate and react to, during the process.

Software Engineer 235

Software Engineer Software Engineering Consulting Entertainment 235

The Pragmatic Engineer

NOVEMBER 21, 2023

In this article, we cover thee out of nine topics from today’s subscriber-only issue: The Past and Future of Modern Backend Practices. To get full issues twice a week, subscribe here.   How have practices considered cutting edge on the backend changed from its early days, and where is it headed in future? and hand-rolled C -code.

Engineering 337

Engineering Bytes Cloud Computing AWS 337

The Pragmatic Engineer

AUGUST 1, 2023

Senior Engineers are not only expected to lead significant projects in their teams, but they have a say in whether that feature is worth building or not. The SDE3 level expects leadership on projects in which this engineer is involved. Wise Wise – formerly Transferwise – is a publicly traded Fintech, valued at $6.5B

Software Engineer 246

Software Engineer Software Engineering Engineering Designing 246

Analytics Vidhya

MARCH 7, 2023

Facebook created Cassandra, which ultimately became an Apache Software Foundation project. Introduction Apache Cassandra is a NoSQL database management system that is open-source and distributed. It is meant to handle massive volumes of data across many commodity servers while maintaining high availability with no single point of failure.

NoSQL 259

NoSQL Database Project Systems 259

The Pragmatic Engineer

OCTOBER 17, 2024

Internal comms: Chat: Slack Coordination / project management: Linear 3. The name comes from the concept of “spare cores:” machines currently unused, which can be reclaimed at any time, that cloud providers tend to offer at a steep discount to keep server utilization high. Source: Spare Cores. Tech stack. Benchmarking tools.

Cloud 326

Cloud AWS Metadata Cloud Computing 326

Christophe Blefari

JANUARY 11, 2025

There are multiple ways to start a new year, either with new projects, new ideas, new resolutions or by just keeping doing the same music. HNY 2025 ( credits ) Happy new year ✨ I wish you the best for 2025. I hope you will enjoy 2025. Thank you so much for your support through the years. Why AI progress is increasingly invisible.

Data 130

Data Data Warehouse Coding Programming Language 130

The Pragmatic Engineer

JUNE 29, 2023

I suspect most respondents use these registrars for side projects, and some use them at work. To get full issues twice a week, subscribe here. Google Domains is the third most popular domain registrar globally, in terms of the number of domains currently registered. Anyone planning on registering a domain may find this list beneficial.

AWS 65

AWS Software Engineer Software Engineering Engineering 65

Analytics Vidhya

FEBRUARY 3, 2023

Say Harish and Lisa are two people working on the same project but on two different systems(say windows and […] The post Getting Started with The Basics of Docker appeared first on Analytics Vidhya. Introduction “Let’s containerize your code to ship worldwide!” Well, my friend, this is what Docker is.

Coding 264

Coding Project Systems IT 264

Start Data Engineering

JULY 26, 2024

Project overview 3. Introduction 2. Check your data before making it available to end-users; Write-Audit-Publish(WAP) pattern 4. TL;DR: How the greatexpectations library works 4.1. greatexpectations quick setup 5. From an implementation perspective, there are four types of tests 5.1. Running checks on one dataset 5.2.

Datasets 208

Datasets Data Project IT 208